00010000:00010000:3.0F:1787614081.905339:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1787614082.865581:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692237312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787614082.865673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614082.865844:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692237312 00000100:00100000:3.0:1787614082.865853:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692237312 00000100:00100000:3.0:1787614082.865918:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787614082.865928:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692237312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787614082.865955:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787614082.866001:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692237312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614082.866008:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787614082.866065:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787614082.866092:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1787614082.866097:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b5d438b7480, transno 8589934596 00000004:00080000:2.0:1787614082.866115:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1787614082.866141:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692237312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787614082.872639:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692237696:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.872705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614082.872743:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692238208:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.872765:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614082.872786:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692238720:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.872809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614082.872829:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787614082.872834:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692237824:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.872852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614082.872868:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692238336:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.872904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614082.872922:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692238848:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.872942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614082.872970:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692237696 00000100:00100000:2.0:1787614082.872977:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692237696 00000100:00100000:2.0:1787614082.873022:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238208 00000100:00100000:2.0:1787614082.873025:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238208 00000100:00100000:2.0:1787614082.874396:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787614082.874408:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e44403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692237696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874484:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e44403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692237696:12345-0@lo:400:kworker.0 Request processed in 79us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614082.874497:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787614082.874514:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787614082.874520:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e47ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692238208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874566:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e47ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692238208:12345-0@lo:400:kworker.0 Request processed in 46us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614082.874572:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787614082.874592:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238720 00000100:00100000:2.0:1787614082.874598:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238720 00000100:00100000:2.0:1787614082.874620:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692237824 00000100:00100000:2.0:1787614082.874623:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692237824 00000100:00100000:2.0:1787614082.874633:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238336 00000100:00100000:2.0:1787614082.874636:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238336 00000100:00100000:2.0:1787614082.874645:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238848 00000100:00100000:2.0:1787614082.874648:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238848 00000100:00100000:2.0:1787614082.874660:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787614082.874665:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d423ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874695:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d423ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692238720:12345-0@lo:400:kworker.0 Request processed in 30us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614082.874701:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787614082.874712:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787614082.874718:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d423c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692237824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874744:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d423c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692237824:12345-0@lo:400:kworker.0 Request processed in 27us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614082.874749:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787614082.874759:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787614082.874763:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d423c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692238336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874798:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d423c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692238336:12345-0@lo:400:kworker.0 Request processed in 34us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614082.874804:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787614082.874816:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787614082.874821:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874448692238848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874847:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874448692238848:12345-0@lo:400:kworker.0 Request processed in 26us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614082.874852:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787614082.874901:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692237824:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874912:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692238336:0@lo:400:kworker.0 00010000:00080000:2.0:1787614082.874923:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7636bb80 x1874448692238848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614082.874933:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692238848:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874943:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692237696:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874953:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692238208:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.874961:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692238720:0@lo:400:kworker.0 00000100:00080000:2.0:1787614082.874992:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787614082.875011:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0F:1787614082.875011:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692237440:0@lo:400:kworker.0 00000100:00080000:2.0:1787614082.875013:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787614082.875016:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787614082.875058:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614082.875096:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692237952:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614082.875141:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692238464:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875206:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614082.875231:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787614082.875238:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692237568:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875261:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614082.875278:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692238080:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875299:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614082.875316:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692238592:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614082.875364:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238080 00000100:00100000:0.0:1787614082.875369:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238080 00000100:00100000:0.0:1787614082.875398:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787614082.875404:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692238080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875442:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692238080:12345-0@lo:400:kworker.0 Request processed in 38us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614082.875447:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787614082.875463:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238464 00000100:00100000:0.0:1787614082.875466:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238464 00000100:00100000:0.0:1787614082.875502:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238592 00000100:00100000:0.0:1787614082.875505:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238592 00000100:00100000:0.0:1787614082.875519:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787614082.875524:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692238464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875563:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692238464:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614082.875575:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787614082.875587:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787614082.875592:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692238592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875618:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692238592:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614082.875623:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787614082.875644:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692237952 00000100:00100000:0.0:1787614082.875647:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692237952 00000100:00100000:0.0:1787614082.875667:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692237568 00000100:00100000:0.0:1787614082.875670:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692237568 00000100:00100000:0.0:1787614082.875680:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787614082.875685:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692237952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875712:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692237952:12345-0@lo:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614082.875716:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787614082.875725:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787614082.875730:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692237568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875749:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692237568:12345-0@lo:400:kworker.0 Request processed in 20us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614082.875754:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787614082.875779:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692237568:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875787:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692238080:0@lo:400:kworker.0 00010000:00080000:0.0:1787614082.875796:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5d4328c000 x1874448692238592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614082.875805:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692238592:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875821:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692237952:0@lo:400:kworker.0 00000100:00100000:0.0:1787614082.875829:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692238464:0@lo:400:kworker.0 00000100:00080000:0.0:1787614082.875857:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787614082.875860:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787614082.875862:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787614082.877184:0:17072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1787614082.877201:0:17072:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b5e7097e600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1787614082.877205:0:17072:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b5d43b54200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b5e7097e9c0 00000020:00080000:2.0:1787614082.877214:0:17072:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b5d43b54300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b5d42c57000 00010000:00010000:2.0:1787614082.877250:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614082.877262:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614082.877270:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614082.877276:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f0a00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614082.877281:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614082.877288:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614082.877305:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5e43b28000) 00010000:00010000:2.0:1787614082.877308:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614082.877312:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614082.877318:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0a00/0x9719586bc2ef06b5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0F:1787614082.878357:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692237440 00000100:00100000:1.0:1787614082.878379:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692237440 00000100:00100000:1.0:1787614082.878442:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787614082.878452:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3635:x1874448692237440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614082.879414:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3635:x1874448692237440:12345-0@lo:400:kworker.0 Request processed in 958us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614082.879424:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000020:00080000:1.0:1787614082.879467:0:17132:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1787614082.881410:0:17132:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787614082.881457:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692237440:0@lo:400:kworker.0 00000100:00100000:2.0:1787614082.881853:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692238976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787614082.881905:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614082.887370:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692238976 00000100:00100000:3.0:1787614082.887385:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692238976 00000100:00100000:3.0:1787614082.887449:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787614082.887460:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692238976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787614082.887484:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787614082.898787:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692238976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11319us (16871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614082.898801:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787614082.899037:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692238976:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787614082.929651:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614083.954317:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614084.011792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.017193:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671190912 00000100:00100000:1.0:1787614084.017208:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671190912 00000100:00100000:1.0:1787614084.017280:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.017371:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.017394:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191040 00000100:00100000:1.0:1787614084.017397:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191040 00000100:00100000:1.0:1787614084.017447:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191168 00000100:00100000:1.0:1787614084.017450:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191168 00000100:00100000:1.0:1787614084.017471:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:1.0:1787614084.017479:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:2400:x1874448671191040:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614084.017556:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:2400:x1874448671191040:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.017564:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 80 00000100:00100000:1.0:1787614084.017581:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00100000:1.0:1787614084.017588:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671191168:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614084.017614:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671191168:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.017635:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 81 00000100:00080000:1.0:1787614084.017656:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787614084.017660:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787614084.017755:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 170 00000100:00100000:1.0:1787614084.017763:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2401:x1874448671190912:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614084.017796:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2401:x1874448671190912:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 33us (6012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.017802:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 170 00000100:00100000:2.0:1787614084.022478:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614084.022554:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191296 00000100:00100000:3.0:1787614084.022563:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191296 00000100:00100000:3.0:1787614084.022629:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:3.0:1787614084.022639:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2399:x1874448671191296:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:3.0:1787614084.022669:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef03e4 00000100:00080000:3.0:1787614084.022684:0:18599:0:(import.c:65:import_set_state_nolock()) ffff8b5d432aa000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787614084.022745:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787614084.022917:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+2:2399:x1874448671191296:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 279us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614084.022925:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00080000:2.0:1787614084.023001:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787614084.023232:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614084.026624:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.026660:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.026686:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191424 00000100:00100000:1.0:1787614084.026696:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191424 00000100:00100000:1.0:1787614084.026753:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:1.0:1787614084.026763:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671191424:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614084.026850:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671191424:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.026858:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:1.0:1787614084.026882:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191552 00000100:00100000:1.0:1787614084.026885:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191552 00000100:00100000:1.0:1787614084.026914:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00100000:1.0:1787614084.026921:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2400:x1874448671191552:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614084.026949:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2400:x1874448671191552:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.026956:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 82 00000100:00080000:1.0:1787614084.026977:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787614084.026987:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787614084.029192:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.029231:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.029258:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614084.029284:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191808 00000100:00100000:1.0:1787614084.029292:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191808 00000100:00100000:1.0:1787614084.029341:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191936 00000100:00100000:1.0:1787614084.029344:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191936 00000100:00100000:1.0:1787614084.029367:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:1.0:1787614084.029376:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2399:x1874448671191808:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:1.0:1787614084.029409:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0423 00000100:00080000:1.0:1787614084.029417:0:18599:0:(import.c:65:import_set_state_nolock()) ffff8b5e67ac8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787614084.029460:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787614084.029597:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+2:2399:x1874448671191808:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 221us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.029605:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:1.0:1787614084.029621:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:1.0:1787614084.029628:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d440c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2399:x1874448671191936:12345-192.168.206.55@tcp:9:kworker.0 00000020:00000080:1.0:1787614084.029639:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef042a 00000100:00080000:1.0:1787614084.029645:0:18599:0:(import.c:65:import_set_state_nolock()) ffff8b5e467bb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787614084.029667:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787614084.029745:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d440c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+2:2399:x1874448671191936:12345-192.168.206.55@tcp:9:kworker.0 Request processed in 116us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614084.029752:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00010000:00010000:1.0:1787614084.029831:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614084.029836:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787614084.029844:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787614084.029847:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614084.030031:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671191680 00000100:00100000:3.0:1787614084.030041:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671191680 00000100:00100000:3.0:1787614084.030086:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00100000:3.0:1787614084.030093:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2400:x1874448671191680:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614084.030127:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2400:x1874448671191680:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 34us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614084.030133:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 83 00000100:00080000:1.0:1787614084.032406:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787614084.919007:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692239104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614084.919078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614084.919130:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239104 00000100:00100000:0.0:1787614084.919137:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239104 00000100:00100000:0.0:1787614084.919195:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787614084.919205:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692239104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787614084.919240:0:17833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787614084.919285:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692239104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614084.919292:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787614084.919353:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692239104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614084.924821:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692239232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614084.924908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614084.924956:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614084.924964:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692239360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787614084.924988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614084.925031:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239360 00000100:00100000:3.0:1787614084.925038:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239360 00000100:00100000:3.0:1787614084.925107:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787614084.925117:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692239360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787614084.925148:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787614084.925212:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692239360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614084.925219:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787614084.925241:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614084.925279:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692239360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787614084.925447:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239232 00000100:00100000:0.0:1787614084.925452:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239232 00000100:00100000:0.0:1787614084.925483:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787614084.925491:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692239232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787614084.925515:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787614084.925578:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692239232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614084.925584:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787614084.925631:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692239232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787614084.943495:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614084.943653:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192064 00000100:00100000:2.0:1787614084.943663:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192064 00000100:00100000:2.0:1787614084.943725:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:2.0:1787614084.943735:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d440c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:15559:x1874448671192064:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787614084.943846:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d440c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:15559:x1874448671192064:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614084.943855:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 65 00000100:00100000:1.0:1787614084.948918:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614084.949006:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192192 00000100:00100000:3.0:1787614084.949016:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192192 00000100:00100000:3.0:1787614084.949078:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00100000:3.0:1787614084.949088:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d440c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:15559:x1874448671192192:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787614084.949221:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d440c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:15559:x1874448671192192:12345-192.168.206.55@tcp:60:lhsmtool_posix.0 Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614084.949236:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 66 00000100:00100000:3.0:1787614084.955410:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614084.956775:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192448 00000100:00100000:2.0:1787614084.956788:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192448 00000100:00100000:2.0:1787614084.956849:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:2.0:1787614084.956859:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:15559:x1874448671192448:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787614084.957093:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+14:15559:x1874448671192448:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 234us (1696us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787614084.957101:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00010000:00010000:3.0:1787614084.991981:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614085.939651:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787614085.939673:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692239488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787614085.939745:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614085.939789:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239488 00000100:00100000:3.0:1787614085.939806:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239488 00000100:00100000:3.0:1787614085.939921:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787614085.939934:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692239488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787614085.939965:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787614085.940073:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692239488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614085.940082:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787614085.940230:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692239488:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787614085.940324:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787614086.001494:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787614086.833963:0:17127:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787614086.833971:0:17127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787614086.833990:0:17127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787614086.834000:0:17127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787614087.025502:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614087.985430:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692239744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787614087.985503:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.985515:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692240000:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.985581:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692240512:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.985629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1874448692241024:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614087.985659:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692240128:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787614087.985681:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692239872:0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.985686:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614087.985706:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692240640:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614087.985724:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.985729:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692240384:0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.985736:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e6718b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1874448692241152:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614087.985756:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.985760:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692240896:0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.985772:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787614087.985776:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692240256:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.985793:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692241408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787614087.985796:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614087.985810:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874448692240768:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.985810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614087.985883:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239872 00000100:00100000:0.0:1787614087.985891:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239872 00000100:00100000:0.0:1787614087.985942:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240384 00000100:00100000:0.0:1787614087.985945:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240384 00000100:00100000:0.0:1787614087.985960:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787614087.985969:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692239872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614087.986256:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3636:1874448692239616:0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.988804:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614087.988826:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692239872:12345-0@lo:400:kworker.0 Request processed in 2846us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614087.988835:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e6718a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1874448692241280:0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.988839:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787614087.988865:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614087.988872:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787614087.988882:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692240384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.988922:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241024 00000100:00100000:3.0:1787614087.988929:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241024 00000100:00100000:0.0:1787614087.988939:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692240384:12345-0@lo:400:kworker.0 Request processed in 60us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.988944:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787614087.988970:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239744 00000100:00100000:0.0:1787614087.988973:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239744 00000100:00100000:3.0:1787614087.988974:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241152 00000100:00100000:3.0:1787614087.988976:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241152 00000100:00100000:3.0:1787614087.988988:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240896 00000100:00100000:3.0:1787614087.988990:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240896 00000100:00100000:0.0:1787614087.988990:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241408 00000100:00100000:0.0:1787614087.988992:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241408 00000100:00100000:3.0:1787614087.989003:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240256 00000100:00100000:0.0:1787614087.989004:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787614087.989005:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240256 00000100:00100000:0.0:1787614087.989009:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d438b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692239744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787614087.989015:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240768 00000100:00100000:3.0:1787614087.989017:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240768 00000100:00100000:3.0:1787614087.989027:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241280 00000100:00100000:3.0:1787614087.989029:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241280 00002000:00000024:0.0:1787614087.989037:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787614087.989043:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787614087.989048:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874448692241024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.989069:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d438b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692239744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614087.989075:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874448692241024:12345-0@lo:400:kworker.0 Request processed in 27us (3422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.989076:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787614087.989081:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787614087.989087:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787614087.989092:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692241408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787614087.989094:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00002000:00000024:0.0:1787614087.989101:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787614087.989124:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692241408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.989130:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787614087.989197:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240000 00000100:00100000:0.0:1787614087.989201:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240000 00000100:00100000:0.0:1787614087.989221:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240512 00000100:00100000:0.0:1787614087.989223:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240512 00000100:00100000:0.0:1787614087.989232:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240128 00000100:00100000:0.0:1787614087.989235:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240128 00000100:00100000:0.0:1787614087.989243:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692240640 00000100:00100000:0.0:1787614087.989245:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692240640 00000100:00100000:0.0:1787614087.989256:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787614087.989262:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692240000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.989495:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692240000:12345-0@lo:400:kworker.0 Request processed in 45us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.989503:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787614087.989517:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787614087.989533:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.989564:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692240512:12345-0@lo:400:kworker.0 Request processed in 42us (3951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.989579:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787614087.989737:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787614087.989745:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692240128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.989784:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692240128:12345-0@lo:400:kworker.0 Request processed in 42us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.989790:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787614087.989801:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787614087.989806:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.989893:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692240640:12345-0@lo:400:kworker.0 Request processed in 86us (4168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.989899:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787614087.990148:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692241408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787614087.990178:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692240000:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.990190:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692240512:0@lo:400:kworker.0 00010000:00080000:2.0:1787614087.990203:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5d4328df80 x1874448692241024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614087.990214:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1874448692241024:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.990246:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692239872:0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.990257:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692240384:0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.990933:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874448692241152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614087.990984:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874448692241152:12345-0@lo:400:kworker.0 Request processed in 59us (5227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.990994:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787614087.991005:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692240896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991052:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692240896:12345-0@lo:400:kworker.0 Request processed in 50us (5272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.991058:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787614087.991082:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787614087.991089:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692240256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991138:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692240256:12345-0@lo:400:kworker.0 Request processed in 50us (5341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.991144:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787614087.991173:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787614087.991181:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874448692240768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991208:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874448692240768:12345-0@lo:400:kworker.0 Request processed in 29us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.991220:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787614087.991232:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787614087.991238:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874448692241280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991267:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874448692241280:12345-0@lo:400:kworker.0 Request processed in 29us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614087.991272:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787614087.991446:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787614087.991451:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787614087.991454:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787614087.991457:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787614087.991514:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692240256:0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991536:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874448692240768:0@lo:400:kworker.0 00010000:00080000:0.0:1787614087.991549:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e6718a680 x1874448692241280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614087.991559:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e6718a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1874448692241280:0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991569:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692240128:0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991579:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692240640:0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991725:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e6718b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1874448692241152:0@lo:400:kworker.0 00000100:00100000:0.0:1787614087.991781:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692240896:0@lo:400:kworker.0 00000100:00100000:1.0:1787614087.992152:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614087.992427:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692239616 00000100:00100000:2.0:1787614087.992434:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692239616 00000100:00100000:2.0:1787614087.992604:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787614087.992613:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3636:x1874448692239616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614087.992659:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3636:x1874448692239616:12345-0@lo:400:kworker.0 Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614087.992666:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787614087.992802:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3636:1874448692239616:0@lo:400:kworker.0 00000100:00100000:1.0:1787614087.992921:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692239744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787614087.993211:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:1.0:1787614088.053499:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787614089.015571:0:17072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787614089.015584:0:17072:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1787614089.015720:0:17132:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1787614089.015733:0:17132:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1787614089.073379:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614089.136863:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614089.136903:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614089.136924:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614089.136948:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614089.136966:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614089.136989:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614089.137022:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192704 00000100:00100000:2.0:1787614089.137034:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192704 00000100:00100000:2.0:1787614089.137082:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193216 00000100:00100000:2.0:1787614089.137085:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193216 00000100:00100000:2.0:1787614089.137098:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192832 00000100:00100000:2.0:1787614089.137100:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192832 00000100:00100000:2.0:1787614089.137111:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193088 00000100:00100000:2.0:1787614089.137113:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193088 00000100:00100000:2.0:1787614089.137128:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:2.0:1787614089.137136:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:2400:x1874448671192704:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614089.137230:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:2400:x1874448671192704:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 94us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614089.137238:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 90 00000100:00100000:2.0:1787614089.137253:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 91 00000100:00100000:2.0:1787614089.137259:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2400:x1874448671193216:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614089.137282:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2400:x1874448671193216:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614089.137288:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 91 00000100:00100000:2.0:1787614089.137300:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 92 00000100:00100000:2.0:1787614089.137306:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671192832:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614089.137340:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671192832:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 34us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614089.137347:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 92 00000100:00100000:2.0:1787614089.137358:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:2.0:1787614089.137363:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2400:x1874448671193088:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614089.137382:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2400:x1874448671193088:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 19us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614089.137388:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 93 00000100:00100000:0.0:1787614089.137483:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192960 00000100:00100000:0.0:1787614089.137488:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192960 00000100:00100000:0.0:1787614089.137532:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:0.0:1787614089.137540:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671192960:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1787614089.137575:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2400:x1874448671192960:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 37us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614089.137582:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00080000:0.0:1787614089.137603:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787614089.137607:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787614089.137609:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787614089.137741:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671192576 00000100:00100000:1.0:1787614089.137746:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671192576 00000100:00100000:1.0:1787614089.137782:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 172 00000100:00100000:1.0:1787614089.137790:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2400:x1874448671192576:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614089.137816:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2400:x1874448671192576:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614089.137822:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 172 00000001:02000400:1.0:1787614089.494603:0:20468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 19:28:07 (1787614087) 00000001:00100000:2.0:1787614089.522614:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a69fec1d-4299-43e1-a021-5ec929e0f017 00000020:00000080:2.0:1787614089.522624:0:18595:0:(genops.c:885:class_export_put()) final put ffff8b5e67ace000/a69fec1d-4299-43e1-a021-5ec929e0f017 00000001:00100000:2.0:1787614089.522643:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000020:00000080:2.0:1787614089.522646:0:18595:0:(genops.c:885:class_export_put()) final put ffff8b5d432a8000/f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000020:00000080:1.0:1787614089.522731:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67ace000/a69fec1d-4299-43e1-a021-5ec929e0f017 for lustre-OST0000 00000020:00000080:1.0:1787614089.522782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d432a8000/f3f326d4-a42c-4905-a1f9-e4b6624938ca for lustre-OST0000 00000020:00000080:1.0:1787614089.522798:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e67ac8800 for lustre-OST0000 00000020:00000080:1.0:1787614089.522811:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d432aa000 for lustre-OST0000 00000001:00100000:3.0:1787614089.525721:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a69fec1d-4299-43e1-a021-5ec929e0f017 00000020:00000080:3.0:1787614089.525729:0:19413:0:(genops.c:885:class_export_put()) final put ffff8b5e467b9000/a69fec1d-4299-43e1-a021-5ec929e0f017 00000020:00000080:2.0:1787614089.525845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e467b9000/a69fec1d-4299-43e1-a021-5ec929e0f017 for lustre-OST0001 00000020:00000080:2.0:1787614089.525901:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e467bb800 for lustre-OST0001 00000100:00100000:1.0:1787614090.034737:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d438b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692241664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787614090.034837:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614090.034901:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787614090.034908:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692241792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787614090.034930:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241664 00000100:00100000:1.0:1787614090.034940:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614090.034942:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241664 00000100:00100000:1.0:1787614090.034981:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241792 00000100:00100000:1.0:1787614090.034986:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241792 00000100:00100000:1.0:1787614090.035103:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787614090.035117:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d438b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692241792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787614090.035153:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787614090.035462:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d438b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692241792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 347us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614090.035470:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787614090.035498:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787614090.035553:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692241792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787614090.041186:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692241536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787614090.041301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614090.041349:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241536 00000100:00100000:2.0:1787614090.041359:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241536 00000100:00100000:0.0:1787614090.041369:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787614090.041381:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d438b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692241664:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787614090.041401:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787614090.041408:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692241536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787614090.041427:0:17833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000004:00000024:0.0:1787614090.041427:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787614090.041482:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692241536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614090.041490:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787614090.041557:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d438b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692241664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (6720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614090.041564:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787614090.041622:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692241536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787614090.044556:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d438b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692241664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787614090.101799:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614091.064345:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787614091.064375:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692241920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787614091.064470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614091.066843:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692241920 00000100:00100000:0.0:1787614091.066870:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692241920 00000100:00100000:0.0:1787614091.066996:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787614091.067010:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692241920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787614091.067050:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1787614091.067240:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787614091.067241:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692241920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614091.067263:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787614091.067329:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692241920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787614091.122658:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787614091.256420:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787614092.155985:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614093.106856:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692242432:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.106928:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.106990:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692242944:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.107011:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.107026:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692243456:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.107055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.107081:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787614093.107087:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d438b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3637:1874448692242048:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.107115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.107136:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692242560:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107306:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242432 00000100:00100000:0.0:1787614093.107315:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242432 00000100:00100000:0.0:1787614093.107369:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242944 00000100:00100000:0.0:1787614093.107373:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242944 00000100:00100000:0.0:1787614093.107399:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787614093.107409:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692242432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107461:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692242432:12345-0@lo:400:kworker.0 Request processed in 54us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.107468:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787614093.107485:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787614093.107491:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692242944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107532:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692242944:12345-0@lo:400:kworker.0 Request processed in 40us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.107538:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787614093.107558:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787614093.107595:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692242304:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.107635:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692242816:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107652:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.107664:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1874448692243328:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107689:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d438b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692242176:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107713:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.107742:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692242688:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107763:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.107778:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692243200:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107802:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242304 00000100:00100000:0.0:1787614093.107805:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242304 00000100:00100000:0.0:1787614093.107848:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242816 00000100:00100000:0.0:1787614093.107851:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242816 00000100:00100000:0.0:1787614093.107868:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787614093.107874:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692242304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107908:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692242304:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.107913:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787614093.107924:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787614093.107931:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692242816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.107956:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692242816:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.107962:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787614093.107976:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787614093.107997:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243456 00000100:00100000:0.0:1787614093.108001:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243456 00000100:00100000:0.0:1787614093.108029:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787614093.108035:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692243456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.108065:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692243456:12345-0@lo:400:kworker.0 Request processed in 30us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.108071:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787614093.108086:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787614093.108240:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242048 00000100:00100000:2.0:1787614093.108244:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242048 00000100:00100000:2.0:1787614093.108280:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787614093.108287:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3637:x1874448692242048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614093.108320:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3637:x1874448692242048:12345-0@lo:400:kworker.0 Request processed in 35us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614093.108327:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787614093.108353:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242176 00000100:00100000:2.0:1787614093.108357:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242176 00000100:00100000:2.0:1787614093.108380:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242688 00000100:00100000:2.0:1787614093.108383:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242688 00000100:00100000:2.0:1787614093.108395:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787614093.108401:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692242176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614093.108432:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692242176:12345-0@lo:400:kworker.0 Request processed in 31us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614093.108437:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787614093.108447:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787614093.108452:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692242688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614093.108477:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692242688:12345-0@lo:400:kworker.0 Request processed in 25us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614093.108482:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787614093.108637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.108676:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692243072:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.108718:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692243584:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614093.108777:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692242432:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108790:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692242944:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108799:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692243456:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108823:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d438b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3637:1874448692242048:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108842:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692242560 00000100:00100000:1.0:1787614093.108845:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692242560 00000100:00100000:1.0:1787614093.108867:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243072 00000100:00100000:1.0:1787614093.108869:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243072 00000100:00100000:1.0:1787614093.108879:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243584 00000100:00100000:1.0:1787614093.108881:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243584 00000100:00100000:1.0:1787614093.108900:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787614093.108907:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692242560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.108941:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692242560:12345-0@lo:400:kworker.0 Request processed in 34us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614093.108958:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787614093.108971:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787614093.108976:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692243072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.109001:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692243072:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614093.109006:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787614093.109016:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787614093.109021:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874448692243584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.109039:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874448692243584:12345-0@lo:400:kworker.0 Request processed in 19us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614093.109044:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787614093.109058:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787614093.109075:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692242560:0@lo:400:kworker.0 00000100:00100000:1.0:1787614093.109084:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692243072:0@lo:400:kworker.0 00010000:00080000:1.0:1787614093.109095:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7614aa00 x1874448692243584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614093.109104:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692243584:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.109594:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.109639:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692243712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787614093.109668:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.109705:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d438b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692242176:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.109715:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692242688:0@lo:400:kworker.0 00000100:00100000:0.0:1787614093.109729:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787614093.109733:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692243840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787614093.109754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614093.109780:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243712 00000100:00100000:0.0:1787614093.109784:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243712 00000100:00100000:0.0:1787614093.109807:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243840 00000100:00100000:0.0:1787614093.109809:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243840 00000100:00100000:0.0:1787614093.109820:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787614093.109827:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692243712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787614093.109851:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787614093.109886:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692243712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.109892:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787614093.109906:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787614093.109912:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692243840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787614093.109921:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787614093.109943:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692243840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614093.109949:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787614093.109988:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692243840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787614093.110003:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692243712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787614093.110133:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243200 00000100:00100000:2.0:1787614093.110138:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243200 00000100:00100000:2.0:1787614093.110217:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787614093.110223:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692243200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614093.110260:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692243200:12345-0@lo:400:kworker.0 Request processed in 37us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614093.110266:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787614093.110283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614093.110322:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692242304:0@lo:400:kworker.0 00000100:00100000:2.0:1787614093.110333:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692242816:0@lo:400:kworker.0 00000100:00100000:3.0:1787614093.110481:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243328 00000100:00100000:3.0:1787614093.110486:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243328 00000100:00100000:3.0:1787614093.110532:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787614093.110539:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874448692243328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614093.110582:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874448692243328:12345-0@lo:400:kworker.0 Request processed in 43us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614093.110588:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1787614093.111224:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e76148700 x1874448692243328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614093.111238:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1874448692243328:0@lo:400:kworker.0 00000100:00080000:0.0:1787614093.111541:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787614093.111546:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787614093.111571:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692243200:0@lo:400:kworker.0 00010000:00010000:3.0:1787614093.172261:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614094.193360:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614094.249429:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.249479:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.249533:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.249570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614094.249572:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193344 00000100:00100000:0.0:1787614094.249589:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193344 00000100:00100000:2.0:1787614094.249611:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.249653:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614094.249679:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 174 00000100:00100000:2.0:1787614094.249693:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193600 00000100:00100000:2.0:1787614094.249703:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193600 00000100:00100000:0.0:1787614094.249705:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2401:x1874448671193344:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614094.249768:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193856 00000100:00100000:2.0:1787614094.249773:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193856 00000100:00100000:2.0:1787614094.249799:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193472 00000100:00100000:2.0:1787614094.249806:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193472 00000100:00100000:0.0:1787614094.249806:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2401:x1874448671193344:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614094.249821:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 174 00000100:00100000:2.0:1787614094.249829:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193984 00000100:00100000:2.0:1787614094.249835:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193984 00000100:00100000:2.0:1787614094.249865:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:2.0:1787614094.249878:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2401:x1874448671193600:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614094.249954:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2401:x1874448671193600:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 81us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614094.249962:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 100 00000100:00100000:2.0:1787614094.249980:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 101 00000100:00100000:2.0:1787614094.249987:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2401:x1874448671193856:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614094.250041:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2401:x1874448671193856:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 55us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614094.250049:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 101 00000100:00100000:2.0:1787614094.250061:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 102 00000100:00100000:2.0:1787614094.250068:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:2401:x1874448671193472:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614094.250091:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:2401:x1874448671193472:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614094.250097:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 102 00000100:00100000:2.0:1787614094.250112:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 103 00000100:00100000:2.0:1787614094.250119:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2401:x1874448671193984:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614094.250140:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2401:x1874448671193984:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614094.250147:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 103 00000100:00100000:2.0:1787614094.250244:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671193728 00000100:00100000:2.0:1787614094.250249:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671193728 00000100:00100000:2.0:1787614094.250307:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:2.0:1787614094.250316:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e6718b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2401:x1874448671193728:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614094.250358:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e6718b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2401:x1874448671193728:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614094.250366:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00080000:2.0:1787614094.250398:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787614094.250403:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787614094.250405:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787614094.418834:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.418949:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671194240 00000100:00100000:2.0:1787614094.418989:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671194240 00000100:00100000:2.0:1787614094.419087:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:2.0:1787614094.419101:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+13:16320:x1874448671194240:12345-192.168.206.55@tcp:35:umount.0 00000001:00080000:2.0:1787614094.419475:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787614094.419588:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1787614094.419764:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+16:16320:x1874448671194240:12345-192.168.206.55@tcp:35:umount.0 Request processed in 665us (937us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1787614094.419774:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000020:00080000:2.0:1787614094.419781:0:17095:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787614094.431080:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614094.431133:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614094.431225:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614094.431319:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671194368 00000100:00100000:3.0:1787614094.431341:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671194368 00000100:00100000:3.0:1787614094.431424:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671194624 00000100:00100000:3.0:1787614094.431428:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671194624 00000100:00100000:3.0:1787614094.431453:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671194496 00000100:00100000:3.0:1787614094.431456:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671194496 00000100:00100000:3.0:1787614094.431475:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:3.0:1787614094.431496:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+15:2402:x1874448671194368:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614094.431518:0:17078:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614094.431555:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0e00/0x9719586bc2ef03c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029243f92 expref: 15 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614094.431580:0:17078:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614094.431651:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+14:2402:x1874448671194368:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 166us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614094.431660:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:3.0:1787614094.431683:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1787614094.431689:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+13:2402:x1874448671194624:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614094.431699:0:17078:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614094.431709:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0600/0x9719586bc2ef044d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244079 expref: 13 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614094.431742:0:17078:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614094.431764:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+12:2402:x1874448671194624:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 75us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614094.431772:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1787614094.431794:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:3.0:1787614094.431802:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f724850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+11:2402:x1874448671194496:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614094.431811:0:17078:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614094.431823:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f1600/0x9719586bc2ef03c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029243fc3 expref: 11 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614094.431837:0:17078:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614094.431861:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f724850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+10:2402:x1874448671194496:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 60us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614094.431867:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:1.0:1787614094.437833:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614094.444276:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671194752 00000100:00100000:0.0:1787614094.444525:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671194752 00000100:00100000:0.0:1787614094.444680:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:0.0:1787614094.444695:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2399:x1874448671194752:12345-192.168.206.55@tcp:9:umount.0 00000020:00000080:0.0:1787614094.444746:0:19016:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef03eb 00000100:00080000:0.0:1787614094.444761:0:19016:0:(import.c:65:import_set_state_nolock()) ffff8b5e44cbf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787614094.444830:0:19016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787614094.445088:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f326d4-a42c-4905-a1f9-e4b6624938ca+2:2399:x1874448671194752:12345-192.168.206.55@tcp:9:umount.0 Request processed in 396us (7269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614094.445099:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00010000:00010000:3.0:1787614094.445192:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614094.474626:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.475075:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671195648 00000100:00100000:2.0:1787614094.475088:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671195648 00000100:00100000:2.0:1787614094.475217:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 67 00000100:00100000:2.0:1787614094.475231:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+16:2399:x1874448671195648:12345-192.168.206.55@tcp:39:umount.0 00000020:00000080:2.0:1787614094.475277:0:17093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef03d6 00000020:00010000:2.0:1787614094.475296:0:17093:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5d44026800: total 0 00000100:00080000:2.0:1787614094.475302:0:17093:0:(import.c:65:import_set_state_nolock()) ffff8b5d44021800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787614094.475329:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1787614094.475651:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f326d4-a42c-4905-a1f9-e4b6624938ca+15:2399:x1874448671195648:12345-192.168.206.55@tcp:39:umount.0 Request processed in 422us (1038us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1787614094.475661:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 67 00000020:00010000:0.0:1787614094.476772:0:17080:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5d44026800: total 0 00010000:00010000:0.0:1787614094.476785:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614094.476865:0:17080:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5d44026800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787614094.477007:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5e601ce300) 00010000:00010000:0.0:1787614094.477012:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787614094.477024:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7af98400/0x9719586bc2ef05ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292440e9 expref: 14 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477047:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5e43b28b00) 00010000:00010000:0.0:1787614094.477049:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787614094.477054:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7af99000/0x9719586bc2ef04bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244087 expref: 13 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477072:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e43b28100) 00010000:00010000:0.0:1787614094.477075:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787614094.477079:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7af99800/0x9719586bc2ef04fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244095 expref: 12 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477092:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5e43b28000) 00010000:00010000:0.0:1787614094.477095:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787614094.477099:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7af98e00/0x9719586bc2ef068b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244113 expref: 11 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477114:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5e601cec00) 00010000:00010000:0.0:1787614094.477116:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787614094.477120:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e40031400/0x9719586bc2ef04a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244080 expref: 10 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477137:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b5e43b28800) 00010000:00010000:0.0:1787614094.477139:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787614094.477143:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7af98600/0x9719586bc2ef0581 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292440bf expref: 9 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477232:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5e601ce300) 00010000:00010000:0.0:1787614094.477235:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787614094.477240:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39400/0x9719586bc2ef06e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924412f expref: 8 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477252:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5e601ce300) 00010000:00010000:0.0:1787614094.477255:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787614094.477258:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7f6f0000/0x9719586bc2ef0630 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292440fe expref: 7 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614094.477273:0:17080:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5d44026800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1787614094.477289:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614094.477291:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614094.477293:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614094.496934:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614094.497883:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671195776 00000100:00100000:2.0:1787614094.497907:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671195776 00000100:00100000:2.0:1787614094.497986:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:2.0:1787614094.497996:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+5:2399:x1874448671195776:12345-192.168.206.55@tcp:39:umount.0 00000020:00000080:2.0:1787614094.498039:0:17092:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef03dd 00000100:00080000:2.0:1787614094.498063:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8b5d44024800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787614094.498101:0:17092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787614094.499139:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614094.499976:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f326d4-a42c-4905-a1f9-e4b6624938ca+3:2399:x1874448671195776:12345-192.168.206.55@tcp:39:umount.0 Request processed in 1967us (3045us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787614094.499992:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 68 00000100:00100000:0.0:1787614095.154030:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787614095.154064:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692243968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614095.154183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614095.154364:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614095.154378:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692244096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614095.154418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614095.154432:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692243968 00000100:00100000:2.0:1787614095.154443:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692243968 00000100:00100000:3.0:1787614095.154459:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787614095.154470:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692244224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787614095.154514:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614095.154526:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244096 00000100:00100000:2.0:1787614095.154531:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244096 00000100:00100000:2.0:1787614095.154555:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787614095.154566:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692243968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787614095.154613:0:17833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787614095.154666:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692243968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614095.154674:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787614095.154696:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787614095.154703:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692244096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787614095.154722:0:17833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787614095.154756:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692244096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614095.154763:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787614095.154814:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692244096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787614095.155022:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692243968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614095.155044:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244224 00000100:00100000:0.0:1787614095.155047:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244224 00000100:00100000:0.0:1787614095.155098:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787614095.155106:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692244224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787614095.155128:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787614095.155198:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692244224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614095.155205:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787614095.155303:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692244224:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787614095.155785:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787614095.217385:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787614096.049822:0:17127:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787614096.049836:0:17127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787614096.049862:0:17127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787614096.049873:0:17127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787614096.178196:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692244352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787614096.178302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614096.178610:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244352 00000100:00100000:3.0:1787614096.178622:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244352 00000100:00100000:3.0:1787614096.178700:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787614096.178714:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692244352:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787614096.178723:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787614096.178756:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787614096.178821:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692244352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614096.178830:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787614096.180373:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692244352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787614096.243922:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614097.174620:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614097.174677:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614097.174722:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614097.174828:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671195904 00000100:00100000:3.0:1787614097.174841:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671195904 00000100:00100000:3.0:1787614097.174922:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671196160 00000100:00100000:3.0:1787614097.174925:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671196160 00000100:00100000:3.0:1787614097.174939:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671196032 00000100:00100000:3.0:1787614097.174941:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671196032 00000100:00100000:3.0:1787614097.174957:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:3.0:1787614097.174968:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+12:2401:x1874448671195904:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614097.174989:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614097.175017:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e82044200/0x9719586bc2ef0400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244002 expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614097.175041:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614097.175105:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+11:2401:x1874448671195904:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 139us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614097.175114:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:3.0:1787614097.175137:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1787614097.175144:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+10:2401:x1874448671196160:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614097.175152:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614097.175222:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e82044600/0x9719586bc2ef0446 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244072 expref: 10 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614097.175233:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614097.175273:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+9:2401:x1874448671196160:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 129us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614097.175294:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1787614097.175312:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1787614097.175319:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+8:2401:x1874448671196032:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614097.175327:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614097.175337:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b38e00/0x9719586bc2ef0407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244033 expref: 8 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614097.175346:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614097.175363:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+7:2401:x1874448671196032:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 45us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614097.175370:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:1.0:1787614097.189772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614097.190300:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671196416 00000100:00100000:2.0:1787614097.190316:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671196416 00000100:00100000:2.0:1787614097.190431:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00100000:2.0:1787614097.190444:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+6:2399:x1874448671196416:12345-192.168.206.55@tcp:39:umount.0 00000020:00000080:2.0:1787614097.190508:0:17093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0415 00000020:00010000:2.0:1787614097.190533:0:17093:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5e4608b000: total 0 00000100:00080000:2.0:1787614097.190538:0:17093:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787614097.190579:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1787614097.190777:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2399:x1874448671196416:12345-192.168.206.55@tcp:39:umount.0 Request processed in 335us (1021us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787614097.190787:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 69 00000100:00080000:0.0:1787614097.191041:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1787614097.191093:0:17080:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5e4608b000: total 0 00010000:00010000:1.0:1787614097.191208:0:17080:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5e4608b000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787614097.191255:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e43b28100) 00010000:00010000:1.0:1787614097.191258:0:17080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787614097.191268:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef050a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924409c expref: 4 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614097.191293:0:17080:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5e4608b000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787614097.191306:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614097.191308:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614097.191310:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614097.205429:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614097.205625:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671196544 00000100:00100000:3.0:1787614097.205639:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671196544 00000100:00100000:3.0:1787614097.205740:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:3.0:1787614097.205754:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69fec1d-4299-43e1-a021-5ec929e0f017+5:2399:x1874448671196544:12345-192.168.206.55@tcp:39:umount.0 00000020:00000080:3.0:1787614097.205817:0:18622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef041c 00000100:00080000:3.0:1787614097.205830:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8b5e67acb800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787614097.205851:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787614097.205914:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787614097.206076:0:18622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787614097.206436:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69fec1d-4299-43e1-a021-5ec929e0f017+3:2399:x1874448671196544:12345-192.168.206.55@tcp:39:umount.0 Request processed in 684us (1137us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787614097.206446:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 70 00000100:00100000:2.0:1787614097.246334:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614097.246419:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671196800 00000100:00100000:1.0:1787614097.246434:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671196800 00000100:00100000:1.0:1787614097.246517:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 175 00000100:00100000:1.0:1787614097.246530:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+7:2399:x1874448671196800:12345-192.168.206.55@tcp:251:umount.0 00000020:00000080:1.0:1787614097.246588:0:17086:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef03b3 00000020:00010000:1.0:1787614097.246598:0:17086:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5d423d8800: total 0 00000100:00080000:1.0:1787614097.246603:0:17086:0:(import.c:65:import_set_state_nolock()) ffff8b5d423d9800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787614097.246717:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a388dd3-93d6-4d6e-98c3-dbfb5507e92f+3:2399:x1874448671196800:12345-192.168.206.55@tcp:251:umount.0 Request processed in 189us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614097.246745:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 175 00000020:00010000:2.0:1787614097.247448:0:17080:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5d423d8800: total 0 00010000:00010000:2.0:1787614097.247454:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614097.247534:0:17080:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5d423d8800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787614097.247578:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e82044c00/0x9719586bc2ef03ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029243f8b expref: 2 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614097.247601:0:17080:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5d423d8800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787614097.247613:0:17080:0:(genops.c:885:class_export_put()) final put ffff8b5d423d8800/6a388dd3-93d6-4d6e-98c3-dbfb5507e92f 00010000:00010000:2.0:1787614097.247640:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614097.247642:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614097.247645:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787614097.248928:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d423d8800/6a388dd3-93d6-4d6e-98c3-dbfb5507e92f for MGS 00000020:00000080:1.0:1787614097.249004:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d423d9800 for MGS 00010000:00010000:2.0:1787614097.266616:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614098.225806:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692244608:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.225924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226001:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692245120:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226041:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692245632:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226096:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787614098.226103:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7c26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3638:1874448692244480:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226188:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874448692244992:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226401:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692245504:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226445:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692246016:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226513:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692244864:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.226540:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.226557:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692245376:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.226737:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787614098.226748:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692246144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787614098.226783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614098.226815:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692244736:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.226841:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614098.226860:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692245248:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.226881:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614098.226899:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692245760:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.226940:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614098.226971:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244608 00000100:00100000:2.0:1787614098.226980:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244608 00000100:00100000:2.0:1787614098.227031:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245120 00000100:00100000:2.0:1787614098.227035:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245120 00000100:00100000:2.0:1787614098.227052:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787614098.227062:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692244608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.227121:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692244608:12345-0@lo:400:kworker.0 Request processed in 60us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.227129:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787614098.227147:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787614098.227153:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692245120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.227247:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692245120:12345-0@lo:400:kworker.0 Request processed in 94us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.227254:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787614098.227277:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245632 00000100:00100000:2.0:1787614098.227281:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245632 00000100:00100000:2.0:1787614098.227313:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244992 00000100:00100000:2.0:1787614098.227315:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244992 00000100:00100000:2.0:1787614098.227325:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245504 00000100:00100000:2.0:1787614098.227328:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245504 00000100:00100000:2.0:1787614098.227337:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246016 00000100:00100000:2.0:1787614098.227339:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246016 00000100:00100000:2.0:1787614098.227351:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245760 00000100:00100000:2.0:1787614098.227354:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245760 00000100:00100000:2.0:1787614098.227370:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787614098.227377:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692245632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.227412:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692245632:12345-0@lo:400:kworker.0 Request processed in 35us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.227428:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787614098.227441:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787614098.227445:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874448692244992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.227483:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874448692244992:12345-0@lo:400:kworker.0 Request processed in 38us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.227489:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787614098.227501:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787614098.227507:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692245504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.227533:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692245504:12345-0@lo:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.227538:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787614098.227550:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787614098.227559:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692246016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614098.227579:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787614098.227591:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692245760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614098.228431:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244480 00000100:00100000:1.0:1787614098.228442:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244480 00000100:00100000:1.0:1787614098.228495:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787614098.228504:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3638:x1874448692244480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614098.235859:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692245760:12345-0@lo:400:kworker.0 Request processed in 8253us (8900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614098.235910:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787614098.235988:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246144 00000100:00100000:3.0:1787614098.236000:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246144 00000100:00100000:0.0:1787614098.236131:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614098.237997:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787614098.238031:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692246144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787614098.239869:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1874448692245888:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.239976:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.240052:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787614098.240065:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692246272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787614098.240098:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614098.240141:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244864 00000100:00100000:0.0:1787614098.240151:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244864 00002000:00000024:3.0:1787614098.240314:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787614098.240317:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692246016:12345-0@lo:400:kworker.0 Request processed in 12756us (13845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.240333:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787614098.240364:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245888 00000100:00100000:2.0:1787614098.240368:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245888 00000100:00100000:2.0:1787614098.240412:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787614098.240421:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874448692245888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.240480:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874448692245888:12345-0@lo:400:kworker.0 Request processed in 61us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614098.240487:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787614098.240509:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692244736 00000100:00100000:2.0:1787614098.240514:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692244736 00000100:00100000:2.0:1787614098.240559:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245248 00000100:00100000:2.0:1787614098.240563:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245248 00000100:00100000:3.0:1787614098.240568:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692246144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2556us (13781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614098.240578:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787614098.240601:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246272 00000100:00100000:3.0:1787614098.240617:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246272 00000100:00100000:3.0:1787614098.240644:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787614098.240683:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692245376 00000100:00100000:0.0:1787614098.240688:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692245376 00000100:00100000:0.0:1787614098.240705:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787614098.240712:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692244736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.240749:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692244736:12345-0@lo:400:kworker.0 Request processed in 38us (13908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614098.240756:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787614098.240767:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787614098.240772:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692245248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.240796:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692245248:12345-0@lo:400:kworker.0 Request processed in 25us (13915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614098.240802:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787614098.240811:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787614098.240816:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1874448692244864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.240843:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1874448692244864:12345-0@lo:400:kworker.0 Request processed in 27us (14302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614098.240848:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787614098.240860:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787614098.240866:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692245376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.240906:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692245376:12345-0@lo:400:kworker.0 Request processed in 40us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614098.240912:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787614098.240932:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1874448692246272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787614098.240950:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787614098.240962:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692244864:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.240979:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692245376:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.240992:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1874448692245888:0@lo:400:kworker.0 00000100:00100000:0.0:1787614098.241026:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692246272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787614098.241250:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692246272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 599us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614098.241257:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787614098.241357:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787614098.241363:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787614098.241367:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787614098.241370:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787614098.241530:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692246144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787614098.250358:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874448692244992:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.250382:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692245504:0@lo:400:kworker.0 00010000:00080000:2.0:1787614098.250546:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e4835b800 x1874448692246016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614098.250562:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692246016:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.251291:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692244608:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.251312:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692245120:0@lo:400:kworker.0 00000100:00100000:2.0:1787614098.251325:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692245632:0@lo:400:kworker.0 00000100:00100000:3.0:1787614098.252717:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692244736:0@lo:400:kworker.0 00000100:00100000:3.0:1787614098.252741:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692245248:0@lo:400:kworker.0 00010000:00080000:3.0:1787614098.252760:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e48359500 x1874448692245760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614098.252772:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692245760:0@lo:400:kworker.0 00000100:00100000:1.0:1787614098.264606:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3638:x1874448692244480:12345-0@lo:400:kworker.0 Request processed in 36078us (38446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614098.264628:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787614098.268818:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7c26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3638:1874448692244480:0@lo:400:kworker.0 00010000:00010000:1.0:1787614098.290893:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614099.315739:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787614099.593324:0:20663:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787614099.624299:0:20663:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787614099.624357:0:20663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614099.624373:0:20663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614099.624381:0:20663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614099.624389:0:20663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614099.624411:0:20663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787614099.624418:0:20663:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787614099.624447:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787614099.624476:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787614099.624483:0:20663:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787614099.624512:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e48560800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787614099.624602:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874448692246400:0@lo:39:umount.0 00000100:00100000:3.0:1787614099.624673:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614099.624773:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246400 00000100:00100000:1.0:1787614099.624781:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246400 00000100:00100000:1.0:1787614099.624836:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787614099.624845:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874448692246400:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787614099.624881:0:18622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeffa7 00000100:00080000:1.0:1787614099.624889:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8b5e473a6800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787614099.624946:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1874448692246400:12345-0@lo:39:umount.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614099.624953:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1787614099.624962:0:18622:0:(genops.c:885:class_export_put()) final put ffff8b5e473a5000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787614099.625020:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614099.625027:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.625034:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38a00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614099.625038:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.625046:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614099.625053:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614099.625068:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787614099.625071:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787614099.625073:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787614099.625100:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.625106:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1787614099.625183:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48560800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787614099.625194:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874448692246400:0@lo:39:umount.0 00000100:00080000:0.0:1787614099.629532:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614099.629539:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787614099.629545:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787614099.632860:0:20663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632879:0:20663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632886:0:20663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632892:0:20663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632903:0:20663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614099.632910:0:20663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632916:0:20663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632928:0:20663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632934:0:20663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632941:0:20663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787614099.632947:0:20663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632954:0:20663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632959:0:20663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632964:0:20663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632971:0:20663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787614099.632975:0:20663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632980:0:20663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.632986:0:20663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.633000:0:20663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.633007:0:20663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787614099.633010:0:20663:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787614099.633039:0:20663:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787614099.633043:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787614099.633047:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614099.633052:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:0.0:1787614099.633059:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b5d44027000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614099.633064:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b5e76200800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614099.633068:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b5e762f1000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614099.633072:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b5e4674c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614099.633079:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8b5e4608b000 a69fec1d-4299-43e1-a021-5ec929e0f017 192.168.206.55@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787614099.633084:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8b5d44026800 f3f326d4-a42c-4905-a1f9-e4b6624938ca 192.168.206.55@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1787614099.633089:0:20663:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8b5d4300b370) has exports, disconnecting them 00000020:00080000:0.0:1787614099.633093:0:20663:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b5d44027000), last request at 1787614098 00000020:00000080:0.0:1787614099.633099:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef02a9 00000100:00080000:0.0:1787614099.633119:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5d44025800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787614099.633187:0:20663:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5d44027000): rc 0 00000020:00000080:0.0:1787614099.633190:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d44027000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1787614099.636275:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636293:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5d43b38a00/0x9719586bc2eeff76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeff7d expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636316:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787614099.636323:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636329:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7630b400 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614099.636333:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636342:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614099.636349:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614099.636355:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787614099.636357:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787614099.636376:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1787614099.636413:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636420:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614099.636442:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636448:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b400/0x9719586bc2eefec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eefece expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636470:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787614099.636473:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636479:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149a200 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614099.636482:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636489:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614099.636495:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614099.636500:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787614099.636502:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787614099.636504:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787614099.636517:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636523:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614099.636535:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636541:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a200/0x9719586bc2ef02da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef02e1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636550:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787614099.636554:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636559:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39e00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614099.636561:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636567:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614099.636572:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614099.636576:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787614099.636578:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787614099.636580:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787614099.636591:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636596:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614099.636602:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636608:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5d43b39e00/0x9719586bc2ef047e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0485 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636626:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614099.636629:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636635:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7630a600 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614099.636638:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636644:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614099.636649:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614099.636654:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787614099.636656:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787614099.636658:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787614099.636670:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636676:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614099.636681:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636687:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a600/0x9719586bc2eefeb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eefec0 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.636695:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614099.636697:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614099.636704:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614099.636716:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614099.636732:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3637:1874448692246656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.636798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614099.636846:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787614099.636852:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3637:1874448692246784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.636876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614099.636907:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246656 00000100:00100000:2.0:1787614099.636913:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246656 00000100:00100000:2.0:1787614099.636954:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246784 00000100:00100000:2.0:1787614099.636957:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246784 00000100:00100000:2.0:1787614099.636993:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787614099.637002:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+25:3637:x1874448692246656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614099.637014:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614099.637028:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b39a00/0x9719586bc2eefece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eefec7 expref: 25 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.637039:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614099.637073:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3637:x1874448692246656:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614099.637080:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787614099.637098:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787614099.637104:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+23:3637:x1874448692246784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614099.637112:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614099.637120:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7630b000/0x9719586bc2ef02e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef02da expref: 23 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.637128:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614099.637189:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+22:3637:x1874448692246784:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614099.637195:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787614099.637230:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3637:1874448692246784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637237:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3637:1874448692246656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637273:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692246912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614099.637314:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787614099.637320:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692246528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637341:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614099.637355:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692247040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637373:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614099.637394:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246912 00000100:00100000:2.0:1787614099.637397:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246912 00000100:00100000:2.0:1787614099.637413:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692246528 00000100:00100000:2.0:1787614099.637416:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692246528 00000100:00100000:2.0:1787614099.637425:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247040 00000100:00100000:2.0:1787614099.637427:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247040 00000100:00100000:2.0:1787614099.637439:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787614099.637444:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+24:3635:x1874448692246912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614099.637451:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614099.637469:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e82044a00/0x9719586bc2ef0485 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef047e expref: 24 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.637480:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614099.637505:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+23:3635:x1874448692246912:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614099.637521:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787614099.637534:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787614099.637541:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f726450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+22:3635:x1874448692246528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614099.637561:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614099.637571:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7630ba00/0x9719586bc2eeff7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eeff76 expref: 22 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.637579:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614099.637602:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f726450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+21:3635:x1874448692246528:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614099.637608:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787614099.637639:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787614099.637645:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+20:3635:x1874448692247040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614099.637652:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614099.637659:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b39000/0x9719586bc2eefec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eefeb9 expref: 20 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614099.637668:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614099.637688:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b+19:3635:x1874448692247040:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614099.637694:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787614099.637720:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692246528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637728:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692247040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614099.637734:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692246912:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787614099.637903:0:20663:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b5e76200800), last request at 1787614098 00000020:00000080:0.0:1787614099.637912:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0144 00000100:00080000:0.0:1787614099.637921:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e7f6b5000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787614099.637950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e473a5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00080000:1.0:1787614099.638209:0:20663:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e76200800): rc 0 00000020:00000080:1.0:1787614099.638212:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e76200800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787614099.638217:0:20663:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b5e762f1000), last request at 1787614018 00000020:00000080:1.0:1787614099.638220:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0095 00000100:00080000:1.0:1787614099.638225:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e762f0000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787614099.638236:0:20663:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e762f1000): rc 0 00000020:00000080:1.0:1787614099.638237:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e762f1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787614099.638241:0:20663:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b5e4674c000), last request at 1787614018 00000020:00000080:1.0:1787614099.638245:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef002c 00000100:00080000:1.0:1787614099.638248:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e7775c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787614099.638253:0:20663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:1.0:1787614099.638330:0:20663:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e4674c000): rc 0 00000004:00000080:1.0:1787614099.638337:0:20663:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa029856ffae0 00000100:00080000:1.0:1787614099.638355:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787614099.638358:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:0.0:1787614099.639123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d44027000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787614099.639153:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e473a6800 for lustre-MDT0000 00000020:00000080:0.0:1787614099.639171:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e76200800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787614099.639192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e762f1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787614099.639214:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d44025800 for lustre-MDT0000 00000020:00000080:0.0:1787614099.639217:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e7f6b5000 for lustre-MDT0000 00000020:00000080:0.0:1787614099.639221:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e762f0000 for lustre-MDT0000 00000100:00080000:1.0:1787614099.639723:0:20663:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787614099.639749:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5d43b91000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787614099.641134:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614099.641268:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614099.642301:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692247168:0@lo:39:umount.0 00000100:00100000:0.0:1787614099.642376:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787614099.642739:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787614099.642743:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1787614099.642761:0:20663:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787614099.642814:0:20663:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787614099.642834:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787614099.642846:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787614099.642848:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1787614099.642867:0:20663:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787614099.642921:0:20663:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787614099.642931:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e67a95000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787614099.642971:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8b5d4300b370) has no exports 00000100:00100000:0.0:1787614099.643201:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692247296:0@lo:9:umount.0 00000100:00100000:0.0:1787614099.643239:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614099.643263:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692247424:0@lo:9:umount.0 00000100:00100000:0.0:1787614099.643284:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614099.643317:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247296 00000100:00100000:0.0:1787614099.643323:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247296 00000100:00100000:0.0:1787614099.643361:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247424 00000100:00100000:0.0:1787614099.643364:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247424 00000100:00100000:0.0:1787614099.643387:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787614099.643396:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874448692247296:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787614099.643581:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef018a 00000100:00080000:0.0:1787614099.643589:0:18599:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787614099.643629:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787614099.643749:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3634:x1874448692247296:12345-0@lo:9:umount.0 Request processed in 353us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614099.643756:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787614099.643771:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787614099.643777:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874448692247424:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787614099.643796:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef02e8 00000100:00080000:0.0:1787614099.643801:0:18599:0:(import.c:65:import_set_state_nolock()) ffff8b5d432af800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787614099.643822:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787614099.643893:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3634:x1874448692247424:12345-0@lo:9:umount.0 Request processed in 115us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614099.643899:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787614099.643921:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787614099.643945:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787614099.643951:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787614099.643953:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787614099.643956:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692247296:0@lo:9:umount.0 00000100:00080000:0.0:1787614099.643965:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e67a95000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787614099.643968:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787614099.643969:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787614099.643972:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692247424:0@lo:9:umount.0 00010000:00010000:0.0:1787614099.643991:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614099.644258:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247168 00000100:00100000:3.0:1787614099.644263:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247168 00000100:00100000:3.0:1787614099.644298:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787614099.644306:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874448692247168:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787614099.644323:0:17833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef00bf 00000100:00080000:3.0:1787614099.644329:0:17833:0:(import.c:65:import_set_state_nolock()) ffff8b5e7775e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787614099.644345:0:17833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787614099.644442:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3634:x1874448692247168:12345-0@lo:39:umount.0 Request processed in 137us (2066us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787614099.644448:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1787614099.644484:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787614099.644602:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d43b91000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787614099.644609:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692247168:0@lo:39:umount.0 00000001:00100000:3.0:1787614099.648107:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787614099.648114:0:19413:0:(genops.c:885:class_export_put()) final put ffff8b5d432ad000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787614099.648130:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000020:00000080:3.0:1787614099.648131:0:19413:0:(genops.c:885:class_export_put()) final put ffff8b5e44cbd800/f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000020:00000080:0.0:1787614099.649269:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d432ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787614099.649310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e44cbd800/f3f326d4-a42c-4905-a1f9-e4b6624938ca for lustre-OST0001 00000020:00000080:0.0:1787614099.649325:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d432af800 for lustre-OST0001 00000020:00000080:0.0:1787614099.649328:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e44cbf000 for lustre-OST0001 00000001:00100000:1.0:1787614099.650602:0:17825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787614099.650613:0:17825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1787614099.650618:0:17825:0:(genops.c:885:class_export_put()) final put ffff8b5e76204000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787614099.650638:0:17825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a69fec1d-4299-43e1-a021-5ec929e0f017 00000001:00080000:1.0:1787614099.650643:0:17825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1787614099.650645:0:17825:0:(genops.c:885:class_export_put()) final put ffff8b5e536c5800/a69fec1d-4299-43e1-a021-5ec929e0f017 00000001:00100000:1.0:1787614099.650650:0:17825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000001:00080000:1.0:1787614099.650655:0:17825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1787614099.650657:0:17825:0:(genops.c:885:class_export_put()) final put ffff8b5d44022800/f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000020:00000080:0.0:1787614099.650691:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e76204000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787614099.650735:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e536c5800/a69fec1d-4299-43e1-a021-5ec929e0f017 for lustre-MDT0001 00000020:00000080:0.0:1787614099.650757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d44022800/f3f326d4-a42c-4905-a1f9-e4b6624938ca for lustre-MDT0001 00000020:00000080:0.0:1787614099.650774:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e7775e000 for lustre-MDT0001 00000020:00000080:0.0:1787614099.650778:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e67acb800 for lustre-MDT0001 00000020:00000080:0.0:1787614099.650781:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d44024800 for lustre-MDT0001 00000020:00080000:1.0:1787614099.659600:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8b5d4300b370) has no exports 00000001:00100000:3.0:1787614099.662542:0:17072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787614099.662550:0:17072:0:(genops.c:885:class_export_put()) final put ffff8b5e4674c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787614099.662569:0:17072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a69fec1d-4299-43e1-a021-5ec929e0f017 00000001:00080000:3.0:1787614099.662578:0:17072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1787614099.662595:0:17072:0:(genops.c:885:class_export_put()) final put ffff8b5e4608b000/a69fec1d-4299-43e1-a021-5ec929e0f017 00000001:00100000:3.0:1787614099.662603:0:17072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000001:00080000:3.0:1787614099.662606:0:17072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1787614099.662611:0:17072:0:(genops.c:885:class_export_put()) final put ffff8b5d44026800/f3f326d4-a42c-4905-a1f9-e4b6624938ca 00000020:00000080:0.0:1787614099.662691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4674c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787614099.662746:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4608b000/a69fec1d-4299-43e1-a021-5ec929e0f017 for lustre-MDT0000 00000020:00000080:0.0:1787614099.662775:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d44026800/f3f326d4-a42c-4905-a1f9-e4b6624938ca for lustre-MDT0000 00000020:00000080:0.0:1787614099.662795:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e7775c800 for lustre-MDT0000 00000020:00000080:0.0:1787614099.662799:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e4608f800 for lustre-MDT0000 00000020:00000080:0.0:1787614099.662803:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d44021800 for lustre-MDT0000 00000020:00000080:1.0:1787614099.706482:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff14 00000020:00000080:1.0:1787614099.708404:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d41e30800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787614099.708425:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787614099.708827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d41e30800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787614099.708857:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614099.708866:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787614099.708870:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8b5d4300cd28) has no exports 00000020:00000080:0.0:1787614099.709516:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff0d 00000020:00000080:0.0:1787614099.709535:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67a90000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787614099.709608:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614099.709616:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787614099.709619:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67933800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787614099.709622:0:20663:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67933800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787614099.709626:0:20663:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787614099.710189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67a90000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787614099.710283:0:20663:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5e507e7060 - data ffff8b5e65097ca8/ffff8b5e7af83000 00000020:01000000:0.0:1787614099.710408:0:20663:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5e438de5a0 - data ffff8b5e6519a438/ffff8b5e77021000 00000001:00000004:0.0:1787614099.729413:0:20663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787614099.788047:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787614099.788056:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787614099.788073:0:20663:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8b5e7614bb80 x1874448692247168/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787614109 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614099.788100:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787614099.795721:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787614099.795728:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1787614099.795747:0:20663:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787614099.795749:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787614099.796778:0:17116:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787614099.796783:0:17116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1787614099.796794:0:17116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787614099.797452:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787614099.797467:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1787614099.797483:0:20663:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787614099.797485:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787614099.800232:0:17118:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787614099.800240:0:17118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1787614099.800253:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787614099.804847:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefedc 00000020:00000080:1.0:1787614099.804859:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d4403a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787614099.805155:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d4403a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787614099.809591:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefef1 00000020:00000080:1.0:1787614099.809605:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67936000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787614099.809623:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787614099.809628:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614099.809638:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787614099.809642:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8b5d430099b8) has no exports 00000020:00000080:0.0:1787614099.809752:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67936000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787614099.809816:0:20663:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787614099.809825:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff53 00000020:00000080:1.0:1787614099.809830:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d41e36000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787614099.809847:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787614099.809851:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614099.809857:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787614099.809859:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8b5e6df90000) has no exports 00000020:00000080:1.0:1787614099.809865:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff4c 00000020:00000080:1.0:1787614099.809869:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67934000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787614099.810060:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d41e36000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787614099.810079:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67934000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787614099.810267:0:20663:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787614099.810271:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787614099.810275:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1787614099.810280:0:20663:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787614099.810282:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614099.810317:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614099.810323:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787614099.810328:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff3e 00000020:00000080:1.0:1787614099.810333:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e6dec8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787614099.810336:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787614099.810339:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614099.810342:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787614099.810344:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8b5d432e3370) has no exports 00000020:00000080:1.0:1787614099.810348:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff37 00000020:00000080:1.0:1787614099.810350:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e6deca800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787614099.810407:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e67a95000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787614099.810415:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5d41e33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787614099.810418:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d41e33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787614099.810426:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787614099.810530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e6dec8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787614099.810537:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e6deca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787614099.810768:0:20663:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787614099.810772:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787614099.810780:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787614099.810784:0:20663:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787614099.810786:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614099.810809:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614099.810814:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787614099.810823:0:20663:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787614099.810828:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff29 00000020:00000080:1.0:1787614099.810833:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e6decb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787614099.810837:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787614099.810840:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614099.810843:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787614099.810845:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8b5d42ee19b8) has no exports 00000020:00000080:1.0:1787614099.810849:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff22 00000020:00000080:1.0:1787614099.810851:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e4321c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787614099.811002:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e6dec9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787614099.811010:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5e6decf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787614099.811012:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e6decf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787614099.811019:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787614099.811069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e6decb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787614099.811076:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4321c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787614099.834567:0:20663:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787614099.834575:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787614099.834580:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787614099.834588:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614099.834699:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614099.834712:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787614099.834744:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614099.834866:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787614099.834873:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e7f666000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787614099.834877:0:20663:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e7f666000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787614099.834889:0:20663:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787614099.834993:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefef8 00000020:00000080:1.0:1787614099.835304:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67932000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787614099.841305:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d43b91000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787614099.841324:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5d440f7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787614099.841328:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d440f7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787614099.841344:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787614099.842966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67932000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787614099.853152:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787614099.853576:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614099.853586:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787614099.853591:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8b5d43008000) has no exports 00000020:00000080:1.0:1787614099.853618:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614099.853634:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787614099.853639:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67930000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787614099.853643:0:20663:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67930000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787614099.853650:0:20663:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787614099.853722:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefeff 00000020:00000080:1.0:1787614099.853729:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e67931800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787614099.853751:0:20663:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d43bf1000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787614099.853755:0:20663:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d43bf1000 3 00000020:01000004:1.0:1787614099.853758:0:20663:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5d43bf1000 from lustre-MDT0000 00000020:00000080:1.0:1787614099.853777:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614099.853781:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787614099.853783:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d4403b000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787614099.853785:0:20663:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d4403b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787614099.853792:0:20663:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787614099.853819:0:20663:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787614099.853822:0:20663:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787614099.853825:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787614099.853828:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614099.853831:0:20663:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787614099.853837:0:20663:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8b5e6dec5000 c94bd3a1-5d0d-4686-a524-bd5061ef9c4b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787614099.853842:0:20663:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8b5d432e4d28) has exports, disconnecting them 00000020:00080000:1.0:1787614099.853846:0:20663:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8b5e6dec5000), last request at 1787614004 00000020:00000080:0.0:1787614099.853972:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67931800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787614099.855932:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefea4 00000020:00010000:1.0:1787614099.855943:0:20663:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5e6dec5000: total 0 00000100:00080000:1.0:1787614099.855948:0:20663:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec7000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787614099.855976:0:20663:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e6dec5000): rc 0 00000020:00080000:1.0:1787614099.855983:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8b5d432e4d28) has no exports 00000020:00010000:0.0:1787614099.856014:0:17081:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5e6dec5000: total 0 00010000:00010000:0.0:1787614099.856074:0:17081:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5e6dec5000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787614099.856105:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2eefeb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eefeab expref: 14 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.856124:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0800/0x9719586bc2eeffc3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eeffbc expref: 13 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614099.858819:0:17084:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8b5e76145a00:17084] 0 exiting: rc = 1 00010000:00010000:0.0:1787614099.858819:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b39600/0x9719586bc2ef012f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef0128 expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858853:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e82045a00/0x9719586bc2ef045b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef0454 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858866:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef0080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef0079 expref: 10 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858879:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b38400/0x9719586bc2eeffd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eeffca expref: 9 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858895:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0c00/0x9719586bc2ef0469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef0462 expref: 8 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858908:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d438f5200/0x9719586bc2eeffdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2eeffd8 expref: 7 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858920:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e82044400/0x9719586bc2ef0477 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef0470 expref: 6 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858949:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7630b600/0x9719586bc2ef026a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef0263 expref: 5 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858961:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b38200/0x9719586bc2ef0105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef00fe expref: 4 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.858970:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d438f4000/0x9719586bc2ef0294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef028d expref: 3 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.859002:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d438f4200/0x9719586bc2ef02d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9719586bc2ef02cc expref: 2 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614099.859013:0:17081:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5e6dec5000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787614099.859039:0:17081:0:(genops.c:885:class_export_put()) final put ffff8b5e6dec5000/c94bd3a1-5d0d-4686-a524-bd5061ef9c4b 00010000:00010000:0.0:1787614099.859056:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614099.859058:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614099.859060:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614099.859084:0:17087:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8b5e60d66c00:17087] 2 exiting: rc = 0 00000100:00100000:0.0:1787614099.859137:0:17086:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8b5e76144e00:17086] 1 exiting: rc = 0 00000020:00000080:1.0:1787614099.859384:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e6dec5000/c94bd3a1-5d0d-4686-a524-bd5061ef9c4b for MGS 00000020:00000080:1.0:1787614099.859426:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e6dec7000 for MGS 00000100:00100000:1.0:1787614099.859539:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859557:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859563:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859570:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859575:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859581:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859587:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859593:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859599:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859605:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859611:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859616:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859620:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859626:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859632:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859636:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859640:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859646:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859651:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859656:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859662:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859666:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859671:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859675:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859680:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859685:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859690:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859695:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859700:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859705:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859710:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859715:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859720:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859726:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859731:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859735:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859748:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859754:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859760:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859765:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859769:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859773:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859778:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859783:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859788:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859794:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859799:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859805:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859810:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859815:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859820:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859826:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859831:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859837:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859842:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859861:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859869:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859874:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859879:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859885:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859890:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859894:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859899:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614099.859904:0:20663:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787614099.870484:0:20663:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5e595facc0 - data ffff8b5e65094bd0/ffff8b5e42d9e800 00000020:01000000:2.0:1787614099.870603:0:20663:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5e7f803d20 - data ffff8b5e65192af8/ffff8b5d4301d400 00000020:00000080:2.0:1787614099.871026:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefe88 00000020:00000080:2.0:1787614099.871034:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d43bf2800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787614099.871052:0:20663:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d43bf1000 from MGS, refs=2 00000020:01000004:2.0:1787614099.871056:0:20663:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d43bf1000 2 00000020:01000004:2.0:1787614099.871059:0:20663:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5d43bf1000 from MGS 00000020:00000080:2.0:1787614099.871079:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787614099.871085:0:20663:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787614099.871087:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d43bf7800/MGS 00000020:00000080:2.0:1787614099.871090:0:20663:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d43bf7800/MGS for MGS 00000020:01000000:2.0:1787614099.871096:0:20663:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787614099.871147:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787614099.871151:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787614099.871171:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787614099.871178:0:20663:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8b5e48564800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787614099.871184:0:20663:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8b5e6df919b8) has exports, disconnecting them 00000020:00080000:2.0:1787614099.871188:0:20663:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8b5e48564800), last request at 1787614004 00000020:00000080:2.0:1787614099.871192:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeff8b 00000020:00000080:0.0:1787614099.871434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d43bf2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1787614099.871941:0:20663:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e48564800): rc 0 00000020:00000080:2.0:1787614099.871947:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5e48564800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787614099.872211:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e48564800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787614099.887292:0:20663:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787614099.887300:0:20663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614099.887304:0:20663:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787614099.887311:0:20663:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787614099.889391:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614099.889402:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787614099.889408:0:20663:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d43bf1000 1 00000020:00000080:0.0:1787614099.889414:0:20663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefe7a 00000020:00000080:0.0:1787614099.889422:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d43bf0000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787614099.889428:0:20663:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787614099.889432:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614099.889435:0:20663:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787614099.889439:0:20663:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8b5d432e0000) has no exports 00000020:00000080:1.0:1787614099.889521:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e48560800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787614099.889529:0:8:0:(genops.c:885:class_export_put()) final put ffff8b5e48563000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787614099.889532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e48563000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787614099.889538:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787614099.889602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d43bf0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787614099.987112:0:20663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614099.987126:0:20663:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787614099.987132:0:20663:0:(genops.c:885:class_export_put()) final put ffff8b5d43bf1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787614099.987137:0:20663:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d43bf1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787614099.987155:0:20663:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787614099.987293:0:20663:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b5d43bf7000 00000020:02000400:0.0:1787614099.987345:0:20663:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787614100.273482:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692247552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614100.273556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614100.273727:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247552 00000100:00100000:2.0:1787614100.273747:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247552 00000100:00100000:2.0:1787614100.273790:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787614100.273799:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874448692247552:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787614100.273807:0:17098:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787614100.273850:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874448692247552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (293us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787614100.273856:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:02020000:2.0:1787614100.273889:0:3637:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787614100.285862:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787614100.285869:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8b5e70b96000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787614100.285874:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787614100.289492:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692247680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787614100.289560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614100.289624:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247680 00000100:00100000:3.0:1787614100.289632:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247680 00000100:00100000:3.0:1787614100.289686:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787614100.289696:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692247680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787614100.289724:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787614100.289767:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692247680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614100.289775:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787614100.289796:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614100.289829:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692247680:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787614100.302485:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8b5e70b96000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614100.302498:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 515 00000100:00080000:2.0:1787614100.302507:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b5e70b96000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614100.302544:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5d4328f800 x1874448692247808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787614100.302597:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692247808:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787614100.302776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614100.303065:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692247808 00000100:00100000:2.0:1787614100.303078:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692247808 00000100:00100000:2.0:1787614100.303123:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787614100.303131:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1874448692247808:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787614100.303150:0:17097:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787614100.327374:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1874448692247808:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 24235us (24591us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787614100.327403:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787614100.327518:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e70b96000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787614100.327523:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787614100.327527:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692247808:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787614100.337382:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614101.361561:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787614101.491004:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787614102.385431:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787614103.349068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787614103.349075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787614103.349078:0:8:0:(import.c:65:import_set_state_nolock()) ffff8b5e70b96000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614103.349086:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1787614103.349091:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787614103.349098:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b5e70b96000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614103.349136:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5d440cbb80 x1874448692248064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614103.349251:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692247936:0@lo:400:kworker.0 00000400:00000100:3.0:1787614103.349304:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874448692247936 offset 0 length 224: 4 00000100:00100000:3.0:1787614103.349348:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692248576:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.349379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614103.349409:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787614103.349414:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692248192:0@lo:400:kworker.0 00000100:00100000:2.0:1787614103.351673:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692248064:0@lo:38:kworker.0 00000100:00100000:2.0:1787614103.351735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614103.351783:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787614103.351791:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692249088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787614103.351819:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614103.351885:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248576 00000100:00100000:2.0:1787614103.351892:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248576 00000100:00100000:2.0:1787614103.351930:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787614103.351938:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874448692248576:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787614103.351946:0:17092:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787614103.351981:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874448692248576:12345-0@lo:400:kworker.0 Request processed in 42us (2601us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787614103.351987:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787614103.352010:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692248448:0@lo:400:kworker.0 00000100:00100000:2.0:1787614103.352036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614103.352055:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692248960:0@lo:400:kworker.0 00000100:00100000:2.0:1787614103.352076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614103.352101:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787614103.352106:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692248320:0@lo:400:kworker.0 00000100:00100000:2.0:1787614103.352128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614103.352143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1874448692248832:0@lo:400:kworker.0 00000100:00100000:2.0:1787614103.352200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614103.352232:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248448 00000100:00100000:2.0:1787614103.352236:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248448 00000100:00100000:2.0:1787614103.352249:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248960 00000100:00100000:2.0:1787614103.352259:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248960 00000100:00100000:2.0:1787614103.352293:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248832 00000100:00100000:2.0:1787614103.352296:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248832 00000100:00100000:2.0:1787614103.352307:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787614103.352314:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692248960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614103.352354:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692248960:12345-0@lo:400:kworker.0 Request processed in 40us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614103.352360:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787614103.352374:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787614103.352378:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874448692248448:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787614103.352382:0:17092:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787614103.352403:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874448692248448:12345-0@lo:400:kworker.0 Request processed in 24us (367us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787614103.352408:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787614103.352418:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787614103.352422:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874448692248832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787614103.352447:0:17092:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787614103.352470:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874448692248832:12345-0@lo:400:kworker.0 Request processed in 46us (270us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787614103.352476:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787614103.352505:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787614103.352510:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787614103.352514:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787614103.354106:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787614103.354128:0:17833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248064 00000100:00100000:3.0:1787614103.354137:0:17833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248064 00000100:00100000:3.0:1787614103.354194:0:17833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787614103.354201:0:17833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1874448692248064:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787614103.354221:0:17833:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787614103.354290:0:17833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1874448692248064:12345-0@lo:38:kworker.0 Request processed in 88us (2555us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787614103.354298:0:17833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787614103.354323:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692249088 00000100:00100000:3.0:1787614103.354328:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692249088 00000100:00100000:3.0:1787614103.354362:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787614103.354369:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692249088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787614103.354396:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787614103.355092:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692249088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 719us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614103.355100:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787614103.355190:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e70b96000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614103.355195:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787614103.355198:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d440cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692248064:0@lo:38:kworker.0 00000100:00080000:3.0:1787614103.355223:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787614103.355255:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692249088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787614103.355297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614103.355326:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248320 00000100:00100000:3.0:1787614103.355331:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248320 00000100:00100000:3.0:1787614103.355358:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248192 00000100:00100000:3.0:1787614103.355361:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248192 00000100:00100000:3.0:1787614103.355387:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787614103.355394:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692248320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.357065:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692248320:12345-0@lo:400:kworker.0 Request processed in 1660us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614103.357079:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787614103.357115:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787614103.357125:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692248192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.357194:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692248192:12345-0@lo:400:kworker.0 Request processed in 72us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614103.357199:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787614103.357229:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614103.357266:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692248192:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.357277:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692248704:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.357311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614103.357345:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692248704 00000100:00100000:3.0:1787614103.357350:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692248704 00000100:00100000:3.0:1787614103.357400:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787614103.357407:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692248704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.360525:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692248704:12345-0@lo:400:kworker.0 Request processed in 3108us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614103.360540:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787614103.360589:0:17088:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787614103.360794:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8b5e777f5f80 x1874448692248704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614103.360809:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692248704:0@lo:400:kworker.0 00000100:00080000:3.0:1787614103.360822:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787614103.360827:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8b5e4732e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787614103.360830:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787614103.360835:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8b5e4732e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614103.360839:0:3635:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 532 00000100:00080000:3.0:1787614103.360845:0:3635:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b5e4732e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614103.360873:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f4700 x1874448692249216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614103.360896:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692248576:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.360926:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1874448692249216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787614103.360965:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614103.360999:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692249216 00000100:00100000:3.0:1787614103.361004:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692249216 00000100:00100000:3.0:1787614103.361030:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787614103.361037:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1874448692249216:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787614103.361068:0:17094:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787614103.361103:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1874448692249216:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 66us (137us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787614103.361109:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787614103.361136:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4732e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614103.361139:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787614103.361142:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1874448692249216:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787614103.389658:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614103.389677:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1787614103.389689:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b5d44020000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614103.395416:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f4700 x1874448692249344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614103.395460:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1874448692248832:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.395477:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692249344:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787614103.395563:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614103.395626:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692249344 00000100:00100000:3.0:1787614103.395633:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692249344 00000100:00100000:3.0:1787614103.395674:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787614103.395683:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692249344:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787614103.395707:0:17092:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787614103.395752:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692249344:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 69us (193us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787614103.395760:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787614103.395807:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614103.395812:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787614103.395815:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692249344:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1787614103.395845:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787614103.395860:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8b5e47ff9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787614103.395864:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787614103.395868:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8b5e47ff9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614103.395872:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787614103.395878:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b5e47ff9800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614103.395895:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f4700 x1874448692249472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614103.395913:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692248448:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.395922:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874448692249472:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787614103.395947:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614103.395975:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692249472 00000100:00100000:3.0:1787614103.395979:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692249472 00000100:00100000:3.0:1787614103.395999:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787614103.396005:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1874448692249472:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787614103.396015:0:17094:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787614103.396048:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1874448692249472:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (99us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787614103.396055:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787614103.396081:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e47ff9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614103.396085:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787614103.396089:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874448692249472:0@lo:38:ptlrpcd_00_03.0 00010000:00080000:3.0:1787614103.396113:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8b5e777f7b80 x1874448692248960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614103.396125:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692248960:0@lo:400:kworker.0 00000100:00100000:3.0:1787614103.396186:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692248320:0@lo:400:kworker.0 00010000:00010000:0.0:1787614103.409558:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787614104.353853:0:20864:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787614104.371129:0:20864:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787614104.371507:0:20864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.371521:0:20864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.371529:0:20864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.371536:0:20864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.371654:0:20864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787614104.371661:0:20864:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787614104.371686:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614104.371690:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787614104.371695:0:20864:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787614104.371701:0:20864:0:(import.c:65:import_set_state_nolock()) ffff8b5e47ff9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787614104.371727:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614104.371728:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787614104.371732:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787614104.372729:0:20864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.372741:0:20864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.372748:0:20864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.372756:0:20864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.372830:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787614104.372839:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.372847:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f1000 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614104.372850:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.372859:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614104.372866:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614104.372871:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614104.372873:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787614104.372876:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787614104.372922:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.372928:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787614104.373049:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3636:1874448692249600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614104.373111:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614104.373224:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692249600 00000100:00100000:1.0:1787614104.373232:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692249600 00000100:00100000:1.0:1787614104.373271:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787614104.373278:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3636:x1874448692249600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787614104.373284:0:17079:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787614104 with bad export cookie 10887830794000072356 00010000:00010000:0.0:1787614104.376011:0:20864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614104.376033:0:20864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376045:0:20864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376053:0:20864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376059:0:20864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376071:0:20864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787614104.376077:0:20864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376098:0:20864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376105:0:20864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376110:0:20864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376118:0:20864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787614104.376123:0:20864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376129:0:20864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376135:0:20864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376141:0:20864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614104.376148:0:20864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787614104.376152:0:20864:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1787614104.376205:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787614104.376212:0:20864:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00010000:00010000:3.0:1787614104.376216:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1000/0x9719586bc2ef0079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0080 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1787614104.376227:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787614104.376234:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787614104.376236:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:0.0:1787614104.376239:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787614104.376246:0:20864:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8b5e51a90000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787614104.376248:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376258:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7630b800 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614104.376263:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787614104.376264:0:20864:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8b5e70b96800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614104.376277:0:20864:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8b5e44410000) has exports, disconnecting them 00000020:00080000:0.0:1787614104.376282:0:20864:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8b5e51a90000), last request at 1787614103 00000020:00000080:0.0:1787614104.376290:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef02be 00010000:00010000:3.0:1787614104.376295:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614104.376304:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787614104.376305:0:20864:0:(import.c:65:import_set_state_nolock()) ffff8b5d42d42800 : changing import state from FULL to CLOSED 10000000:01000000:3.0:1787614104.376313:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614104.376316:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787614104.376318:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00080000:0.0:1787614104.376337:0:20864:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e51a90000): rc 0 00000020:00000080:0.0:1787614104.376340:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e51a90000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787614104.376351:0:20864:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8b5e70b96800), last request at 1787614103 00010000:00010000:3.0:1787614104.376353:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787614104.376355:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0159 00010000:00010000:3.0:1787614104.376362:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1787614104.376363:0:20864:0:(import.c:65:import_set_state_nolock()) ffff8b5e51a97800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787614104.376387:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376394:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630b800/0x9719586bc2eeffd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeffdf expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376403:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787614104.376407:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376413:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149b800 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614104.376422:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376429:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614104.376446:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614104.376451:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614104.376453:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787614104.376455:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787614104.376469:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376474:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787614104.376481:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376487:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e4149b800/0x9719586bc2ef02cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef02d3 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376503:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787614104.376506:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376511:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045000 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614104.376513:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376519:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614104.376530:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614104.376535:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787614104.376536:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787614104.376538:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787614104.376550:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.376555:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1787614104.376771:0:20864:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e70b96800): rc 0 00000020:00000080:0.0:1787614104.376774:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e70b96800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00100000:2.0:1787614104.376775:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00000080:0.0:1787614104.376784:0:20864:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa02981617ae0 00000100:00100000:2.0:1787614104.376789:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3636:1874448692249984:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787614104.376804:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614104.376814:0:20864:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8b5d4328df80 x1874448692247552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787614116 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614104.376824:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787614104.376857:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614104.376919:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692249984 00000100:00100000:2.0:1787614104.376928:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692249984 00000100:00100000:2.0:1787614104.376966:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787614104.376974:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3636:x1874448692249984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787614104.376980:0:17078:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787614104 with bad export cookie 10887830794000072356 00000100:00100000:2.0:1787614104.377020:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3636:x1874448692249984:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (163us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787614104.377027:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787614104.377065:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787614104.377069:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787614104.377073:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787614104.377114:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.377122:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e82045000/0x9719586bc2ef0470 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2ef0477 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.377134:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614104.377138:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.377145:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7630ae00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614104.377149:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.377178:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614104.377185:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614104.377202:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614104.377205:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787614104.377208:0:17080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1787614104.378108:0:20864:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787614104.378114:0:20864:0:(import.c:65:import_set_state_nolock()) ffff8b5e70b96000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1787614104.378211:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787614104.378487:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e51a90000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787614104.378636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e70b96800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787614104.378659:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d42d42800 for lustre-MDT0001 00000020:00000080:0.0:1787614104.378662:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e51a97800 for lustre-MDT0001 00000100:00080000:0.0:1787614104.378773:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787614104.378777:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787614104.378788:0:20864:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787614104.378852:0:20864:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787614104.378869:0:20864:0:(import.c:65:import_set_state_nolock()) ffff8b5e51a96800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787614104.378885:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787614104.378888:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787614104.378897:0:20864:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787614104.379703:0:20864:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787614104.379721:0:20864:0:(import.c:65:import_set_state_nolock()) ffff8b5e4674d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787614104.379763:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8b5e44410000) has no exports 00000100:00100000:1.0:1787614104.384789:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3636:x1874448692249600:12345-0@lo:103:ldlm_bl.0 Request processed in 11503us (11671us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787614104.384803:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787614104.402044:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.155@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787614104.402050:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787614104.402059:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5d43b85180 x1874448692247936/t0(0) o400->MGC192.168.206.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787614119 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614104.402074:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f7b80 x1874448692249600/t0(0) o103->MGC192.168.206.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787614120 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614104.402083:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f4700 x1874448692249984/t0(0) o103->MGC192.168.206.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787614120 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787614104.402100:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787614104.402102:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787614104.402104:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787614104.402124:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614104.402130:0:3636:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1787614104.402139:0:3636:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff8b5e6dec0000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614104.402331:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3635:1874448692247936:0@lo:400:kworker.0 00000100:00100000:3.0:1787614104.402366:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:0:1874448692249728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787614104.402374:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692247552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614104.402393:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614104.402398:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:0:1874448692249856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787614104.402445:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692250112:0@lo:9:umount.0 00000100:00100000:2.0:1787614104.402451:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48472300 x1874448692250368/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787614104.402477:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3636:1874448692249600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614104.402493:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3636:1874448692249984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787614104.402515:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614104.402550:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692250240:0@lo:9:umount.0 00000100:00100000:3.0:1787614104.402572:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614104.402599:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3634:1874448692250368:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1787614104.402615:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874448692250368 offset 0 length 520: 4 00000100:00100000:0.0:1787614104.402668:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692250112 00000100:00100000:0.0:1787614104.402676:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692250112 00000100:00100000:1.0:1787614104.403194:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692250240 00000100:00100000:1.0:1787614104.403200:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692250240 00010000:00010000:3.0:1787614104.403225:0:17080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.403235:0:17080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787614104.403255:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614104.403264:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ae00/0x9719586bc2eeffca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9719586bc2eeffd1 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614104.403274:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:0:1874448692250496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787614104.403290:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614104.403301:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614104.403303:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614104.403470:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787614104.403481:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874448692250112:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787614104.403505:0:18598:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0183 00000100:00080000:0.0:1787614104.403515:0:18598:0:(import.c:65:import_set_state_nolock()) ffff8b5d42c38800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787614104.403575:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787614104.403704:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3634:x1874448692250112:12345-0@lo:9:umount.0 Request processed in 224us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614104.403711:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787614104.403754:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787614104.403876:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e51a96800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787614104.403897:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787614104.403899:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787614104.403903:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692250112:0@lo:9:umount.0 00000100:00100000:1.0:1787614104.404101:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787614104.404111:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874448692250240:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787614104.404126:0:18601:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef02ef 00000100:00080000:1.0:1787614104.404134:0:18601:0:(import.c:65:import_set_state_nolock()) ffff8b5d432ac000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787614104.404193:0:18601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787614104.404296:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3634:x1874448692250240:12345-0@lo:9:umount.0 Request processed in 188us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614104.404302:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1787614104.404361:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787614104.404495:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4674d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787614104.404546:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787614104.404764:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787614104.404770:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692250240:0@lo:9:umount.0 00000020:00080000:0.0:1787614104.409919:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8b5e44410000) has no exports 00000020:01000000:1.0:1787614104.460309:0:20864:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5e507e7ba0 - data ffff8b5e65097510/ffff8b5e7af81400 00000020:01000000:1.0:1787614104.460468:0:20864:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5e438de7e0 - data ffff8b5e6518ed80/ffff8b5e7c243000 00010000:00010000:2.0:1787614104.461005:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787614104.470084:0:20864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1787614104.516124:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787614104.516132:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787614104.516139:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787614104.518483:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787614104.518491:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787614104.518513:0:20864:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787614104.518515:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787614104.518856:0:17834:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787614104.518862:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787614104.518873:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787614104.519484:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787614104.519488:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787614104.519506:0:20864:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787614104.519508:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787614104.519935:0:17836:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787614104.519939:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787614104.519946:0:17836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787614104.522530:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeffed 00000020:00000080:1.0:1787614104.522541:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e70b97000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787614104.523194:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0002 00000020:00000080:1.0:1787614104.523201:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e4674b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787614104.523206:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787614104.523212:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614104.523219:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787614104.523224:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8b5e44414d28) has no exports 00000004:01000000:1.0:1787614104.523369:0:20864:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787614104.523377:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0056 00000020:00000080:1.0:1787614104.523381:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e762f5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787614104.523385:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787614104.523389:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614104.523393:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787614104.523396:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8b5d42ee3370) has no exports 00000020:00000080:1.0:1787614104.523401:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef004f 00000020:00000080:1.0:1787614104.523404:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e48464000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787614104.523770:0:20864:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787614104.523774:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787614104.523778:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787614104.523783:0:20864:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787614104.523785:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614104.523812:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614104.523819:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787614104.523824:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0041 00000020:00000080:1.0:1787614104.523829:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e48465000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787614104.523832:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787614104.523836:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614104.523839:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787614104.523841:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8b5e6df94d28) has no exports 00000020:00000080:1.0:1787614104.523853:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef003a 00000020:00000080:1.0:1787614104.523857:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e51a91000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787614104.524201:0:20864:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787614104.524205:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787614104.524207:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787614104.524211:0:20864:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787614104.524212:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614104.524234:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614104.524239:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787614104.524248:0:20864:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787614104.524253:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0025 00000020:00000080:1.0:1787614104.524259:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e4674c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787614104.524263:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787614104.524266:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614104.524269:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787614104.524271:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8b5e444119b8) has no exports 00000020:00000080:1.0:1787614104.524275:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef001e 00000020:00000080:1.0:1787614104.524278:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e70b95800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787614104.525172:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e70b97000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787614104.525183:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4674b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1787614104.525188:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e762f5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787614104.525193:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e48464000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787614104.525198:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e4674d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787614104.525203:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5e48462000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787614104.525205:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e48462000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787614104.525209:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787614104.525285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e48465000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787614104.525290:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e51a91000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787614104.525294:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e51a96800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787614104.525313:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5e762f0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787614104.525315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e762f0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787614104.525318:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787614104.525347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4674c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787614104.525351:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e70b95800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787614104.525641:0:20864:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787614104.525646:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614104.525649:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787614104.525654:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787614104.525701:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614104.525719:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787614104.525748:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614104.525752:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787614104.525755:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e70b92000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787614104.525758:0:20864:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e70b92000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787614104.525774:0:20864:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787614104.525885:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0009 00000020:00000080:0.0:1787614104.525891:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e46749000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787614104.525896:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787614104.525899:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614104.525904:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787614104.525907:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8b5e44413370) has no exports 00000020:00000080:0.0:1787614104.525924:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614104.525927:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787614104.525930:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0010 00000020:00000080:0.0:1787614104.525933:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e4674f000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787614104.525940:0:20864:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5e48561800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787614104.525943:0:20864:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5e48561800 2 00000020:01000004:0.0:1787614104.525946:0:20864:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5e48561800 from lustre-MDT0001 00000020:00000080:0.0:1787614104.526145:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614104.526150:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787614104.526153:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e70b95000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787614104.526173:0:20864:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e70b95000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787614104.526182:0:20864:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787614104.526213:0:20864:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787614104.526217:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787614104.526220:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614104.526224:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787614104.526230:0:20864:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8b5e47ff8000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614104.526235:0:20864:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8b5e7afb3370) has exports, disconnecting them 00000020:00080000:0.0:1787614104.526240:0:20864:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8b5e47ff8000), last request at 1787614018 00000020:00000080:0.0:1787614104.526243:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef008e 00000020:00080000:0.0:1787614104.526254:0:20864:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e47ff8000): rc 0 00000020:00000080:0.0:1787614104.526258:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e47ff8000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787614104.527109:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e70b96000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787614104.527120:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5e4674a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787614104.527122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4674a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787614104.527129:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787614104.527271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e46749000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787614104.527276:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5e70b94000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787614104.527278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e70b94000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787614104.527282:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787614104.527396:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4674f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787614104.527401:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e47ff8000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787614104.544278:0:20864:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787614104.544287:0:20864:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787614104.544290:0:20864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787614104.544299:0:20864:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614104.544518:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614104.544527:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787614104.544535:0:20864:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5e48561800 1 00000020:00000080:1.0:1787614104.544542:0:20864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eeffb5 00000020:00000080:1.0:1787614104.544550:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5e67acf000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787614104.545042:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e47ff9800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787614104.545051:0:37:0:(genops.c:885:class_export_put()) final put ffff8b5e47ff8800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787614104.545054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e47ff8800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787614104.545066:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1787614104.545282:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787614104.545288:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614104.545293:0:20864:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787614104.545298:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8b5e6df93370) has no exports 00000020:00000080:3.0:1787614104.545805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67acf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787614104.574130:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614104.574151:0:20864:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787614104.574359:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5d41e32800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787614104.574364:0:20864:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d41e32800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787614104.574374:0:20864:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787614104.574494:0:20864:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b5e48560000 00000020:01000000:1.0:1787614104.574512:0:20864:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787614104.574516:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614104.574520:0:20864:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787614104.574523:0:20864:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8b5d420899b8) has no exports 00000100:00100000:3.0:1787614104.574873:0:17092:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8b5d42ed3c00:17092] 0 exiting: rc = 1 00000100:00100000:3.0:1787614104.574985:0:17094:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8b5e70a3a400:17094] 2 exiting: rc = 0 00000100:00100000:3.0:1787614104.575038:0:17093:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8b5e67ae0200:17093] 1 exiting: rc = 0 00000100:00100000:0.0:1787614104.576312:0:18622:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8b5e7af11e00:18622] 3 exiting: rc = 0 00000100:00100000:1.0:1787614104.580070:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580080:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580086:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580092:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580474:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580485:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580491:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580497:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580503:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580508:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580513:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580519:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580526:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580532:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580538:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580544:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580549:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580555:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580630:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580639:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580645:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580650:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580658:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580664:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580670:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580688:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580695:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580702:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580828:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580837:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580843:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580849:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580854:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580863:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580869:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580875:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580881:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580887:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580893:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580899:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580908:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580913:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580918:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580923:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580929:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580945:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580962:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580968:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580974:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580979:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580984:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580989:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.580994:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581001:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581005:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581010:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581015:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581021:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581026:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581031:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581044:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581049:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581054:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.581059:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.585824:0:17095:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8b5e67aea600:17095] 0 exiting: rc = 1 00000100:00100000:1.0:1787614104.586200:0:17096:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8b5e70a3aa00:17096] 1 exiting: rc = 0 00000100:00100000:0.0:1787614104.586337:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586356:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586363:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586369:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586374:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586379:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586384:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586389:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586395:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586400:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586405:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586411:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586416:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586421:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586426:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586440:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586446:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586451:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586456:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586461:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586467:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586473:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586478:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586484:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586489:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586494:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586500:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586505:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586510:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586515:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586520:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586525:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586530:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586535:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586540:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586545:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586556:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586629:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586637:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586642:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586647:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586652:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586657:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586663:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586668:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586672:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586677:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586682:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586687:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586692:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586697:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586702:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586775:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586783:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586788:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586793:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586798:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586802:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586807:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586812:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586817:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586822:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586827:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.586832:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.587532:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8b5d422e4000:17097] 0 exiting: rc = 1 00000100:00100000:3.0:1787614104.588014:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8b5d422e5800:17098] 1 exiting: rc = 0 00000100:00100000:1.0:1787614104.588219:0:17833:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8b5d42149c00:17833] 2 exiting: rc = 0 00000100:00100000:0.0:1787614104.588326:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588334:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588340:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588346:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588351:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588357:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588371:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588387:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588392:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588398:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588404:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588412:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588417:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588423:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588429:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588445:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588452:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588458:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588478:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588484:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588490:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588496:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588501:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588506:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588512:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588518:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588524:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588529:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588535:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588540:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588557:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588572:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588578:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588585:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588591:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588614:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588633:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588646:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588652:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588658:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588664:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588670:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588695:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588701:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588715:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588721:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588726:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588732:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588738:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588743:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588749:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588755:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588760:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588765:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588782:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588788:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588794:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588800:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588806:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588813:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588818:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588825:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588831:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.588841:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.606564:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8b5d422e4c00:17099] 0 exiting: rc = 1 00000100:00100000:0.0:1787614104.606794:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8b5d422e5c00:17100] 1 exiting: rc = 0 00000100:00100000:3.0:1787614104.606896:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.606916:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.606923:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.606930:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.606941:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607075:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607086:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607094:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607101:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607108:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607115:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607121:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607127:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607135:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607143:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607150:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607249:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607261:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607271:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607280:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607291:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607296:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607300:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607306:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607310:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607324:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607329:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607333:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607338:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607343:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607395:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607402:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607409:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607416:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607423:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607441:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607457:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607465:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607471:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607479:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607485:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607493:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607501:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607506:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607513:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607520:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607527:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607533:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607539:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607546:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607553:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607564:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607574:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607585:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607596:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607602:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607607:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607612:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607623:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607631:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607636:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607641:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607646:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.607651:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.608497:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8b5e678e2800:17102] 1 exiting: rc = 0 00000100:00100000:1.0:1787614104.608669:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8b5e678e2600:17101] 0 exiting: rc = 1 00000100:00100000:3.0:1787614104.608812:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608819:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608824:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608830:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608835:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608841:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608846:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608860:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608867:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608872:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608877:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608883:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608888:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608894:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608899:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608904:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608909:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608947:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608962:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608970:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608978:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608986:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.608993:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609001:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609008:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609015:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609023:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609031:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609037:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609045:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609052:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609060:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609067:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609075:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609082:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609089:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609097:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609104:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609111:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609118:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609125:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609133:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609150:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609180:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609188:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609198:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609209:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609216:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609221:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609232:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609239:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609244:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609249:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609255:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609368:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609377:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609381:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609386:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609391:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609396:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609400:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609406:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609411:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.609417:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614104.609854:0:17104:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8b5e6e3fbc00:17104] 1 exiting: rc = 0 00000100:00100000:1.0:1787614104.610067:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8b5e6e3fac00:17103] 0 exiting: rc = 1 00000100:00100000:3.0:1787614104.610265:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610271:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610276:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610281:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610287:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610292:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610297:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610302:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610307:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610312:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610317:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610322:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610328:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610345:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610352:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610360:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610367:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610374:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610382:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610390:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610397:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610403:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610411:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610418:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610425:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610444:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610452:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610460:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610467:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610474:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610481:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610489:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610496:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610504:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610514:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610521:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610528:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610538:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610548:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610559:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610569:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610575:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610579:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610584:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610588:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610657:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610666:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610674:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610689:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610697:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610704:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610785:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610796:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610805:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610814:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610825:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610830:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610836:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610842:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610847:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610852:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610858:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610863:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.610868:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614104.611585:0:17105:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8b5e678e2e00:17105] 0 exiting: rc = 1 00000100:00100000:0.0:1787614104.611892:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8b5e678e2a00:17106] 1 exiting: rc = 0 00000100:00100000:0.0:1787614104.612137:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8b5e678e2200:17107] 2 exiting: rc = 0 00000100:00100000:3.0:1787614104.612316:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612322:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612327:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612332:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612337:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612349:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612356:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612362:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612367:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612373:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612378:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612383:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612389:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612395:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612418:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612425:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612429:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612445:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612451:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612468:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612473:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612479:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612485:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612490:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612496:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612502:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612508:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612513:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612518:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612524:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612529:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612535:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612540:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612546:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612552:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612558:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612563:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612570:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612591:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612598:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612604:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612609:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612614:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612621:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612626:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612631:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612638:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612644:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612650:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612656:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612662:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612668:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612674:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612680:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612692:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612698:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612703:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612786:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612793:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612801:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612807:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612813:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612819:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614104.612825:0:20864:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787614104.618496:0:20864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787614104.618509:0:20864:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787614104.618516:0:20864:0:(genops.c:885:class_export_put()) final put ffff8b5d43b94000/MDS_uuid 00000020:00000080:3.0:1787614104.618520:0:20864:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d43b94000/MDS_uuid for MDS 00000020:01000000:3.0:1787614104.618526:0:20864:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787614104.618690:0:20864:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787614105.521464:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787614105.910436:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787614105.910445:0:18595:0:(genops.c:885:class_export_put()) final put ffff8b5d42c3e800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787614105.910473:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787614105.910475:0:18595:0:(genops.c:885:class_export_put()) final put ffff8b5e4608e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787614105.910534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d42c3e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787614105.910582:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4608e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787614105.910598:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d42c38800 for lustre-OST0000 00000020:00000080:1.0:1787614105.910603:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e4608d800 for lustre-OST0000 00010000:00010000:3.0:1787614106.549130:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614107.570457:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787614108.465729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787614108.465736:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787614108.465739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787614108.465743:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787614108.465746:0:8:0:(import.c:65:import_set_state_nolock()) ffff8b5e4732e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614108.465754:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 600 00000100:00080000:3.0:1787614108.465759:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787614108.465767:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b5e4732e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614108.465802:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f4a80 x1874448692250624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787614108.465847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787614108.465851:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787614108.465853:0:8:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614108.465857:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 600 00000100:00080000:3.0:1787614108.465859:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787614108.465863:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b5d44020000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614108.465874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f5500 x1874448692250880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614108.465913:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1874448692250624:0@lo:38:kworker.0 00000400:00000100:3.0:1787614108.465960:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692250624 offset 0 length 520: 4 00000100:00100000:3.0:1787614108.465999:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692250880:0@lo:38:kworker.0 00000400:00000100:3.0:1787614108.466017:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692250880 offset 0 length 520: 4 00000100:00100000:3.0:1787614108.466045:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692250752:0@lo:400:kworker.0 00000400:00000100:3.0:1787614108.466062:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692250752 offset 0 length 224: 4 00000100:00100000:3.0:1787614108.466076:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614108.466080:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692251008:0@lo:400:kworker.0 00000400:00000100:3.0:1787614108.466095:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251008 offset 0 length 224: 4 00000020:01000004:0.0:1787614108.491883:0:21064:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787614108.500309:0:21064:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787614108.500359:0:21064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614108.500372:0:21064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614108.500398:0:21064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614108.500405:0:21064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614108.500440:0:21064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787614108.500446:0:21064:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787614108.500473:0:21064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614108.500496:0:21064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f4a80 x1874448692250624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787614123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614108.500513:0:21064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787614108.500518:0:21064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787614108.500524:0:21064:0:(import.c:65:import_set_state_nolock()) ffff8b5e4732e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787614108.500528:0:21064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614108.500532:0:21064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f4a80 x1874448692250624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787614123 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614108.500540:0:21064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787614108.500543:0:21064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787614108.500749:0:17081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614108.500757:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614108.500765:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d438f5000 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:1.0:1787614108.500768:0:17081:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614108.500778:0:17081:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787614108.500786:0:17081:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614108.500792:0:17081:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787614108.500801:0:17081:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787614108.500804:0:17081:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787614108.500817:0:17081:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:1.0:1787614108.500820:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614108.500827:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5000/0x9719586bc2ef0128 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef012f expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614108.500839:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614108.500841:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614108.500843:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614108.501574:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1874448692250624:0@lo:38:kworker.0 00000100:00080000:0.0:1787614108.508204:0:21064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787614108.509018:0:21064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f5880 x1874448692250752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614124 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614108.509042:0:21064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787614108.509049:0:21064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787614108.509073:0:21064:0:(import.c:65:import_set_state_nolock()) ffff8b5e678e9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787614108.509149:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692250752:0@lo:400:kworker.0 00000100:00100000:3.0:1787614108.509200:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1874448692251136:0@lo:39:umount.0 00000400:00000100:3.0:1787614108.509388:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251136 offset 0 length 224: 4 00010000:00010000:1.0:1787614108.593443:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787614109.491045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787614109.491062:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614109.491065:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787614109.491068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787614109.491489:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787614109.495496:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692251264:0@lo:400:kworker.0 00000400:00000100:0.0:1787614109.495571:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251264 offset 0 length 224: 4 00010000:00010000:1.0:1787614109.617517:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787614110.004329:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787614110.004349:0:19413:0:(genops.c:885:class_export_put()) final put ffff8b5d432a9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787614110.004458:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d432a9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787614110.004509:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d432ac000 for lustre-OST0001 00010000:00010000:1.0:1787614110.641930:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614111.665403:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614112.689517:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787614113.521498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787614113.521508:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614113.521511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787614113.521515:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787614113.521658:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692251392:0@lo:400:kworker.0 00000400:00000100:1.0:1787614113.521711:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251392 offset 0 length 224: 4 00010000:00010000:1.0:1787614113.714123:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614114.673430:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614104/real 1787614104] req@ffff8b5e48472300 x1874448692250368/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787614114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614114.673462:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e48472300 x1874448692250368/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787614114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787614114.673480:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787614114.673507:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787614114.673511:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3634:1874448692250368:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1787614114.673653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787614114.673659:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787614114.673662:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614114.673666:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 601 00000100:00080000:2.0:1787614114.673671:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.155@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787614114.673678:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff8b5e6dec0000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614114.673707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48470a80 x1874448692251520/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787614114.673747:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787614114.673752:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787614114.673826:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692251648:0@lo:400:kworker.0 00000400:00000100:1.0:1787614114.673872:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251648 offset 0 length 224: 4 00000100:00100000:0.0:1787614114.674041:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3634:1874448692251520:0@lo:250:kworker.0 00000400:00000100:0.0:1787614114.674064:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874448692251520 offset 0 length 520: 4 00010000:00010000:1.0:1787614114.737473:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614115.761353:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614116.787139:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614117.809317:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614118.769329:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614108/real 1787614108] req@ffff8b5e763c4380 x1874448692251136/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787614118 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614118.769371:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e763c4380 x1874448692251136/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787614118 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787614118.769392:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e678e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787614118.769434:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1874448692251136:0@lo:39:umount.0 00000100:00080000:3.0:1787614118.769573:0:21064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787614118.769578:0:21064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787614118.769584:0:21064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787614118.772502:0:21064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772521:0:21064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772527:0:21064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772534:0:21064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772631:0:21064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787614118.772641:0:21064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772649:0:21064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772655:0:21064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614118.772661:0:21064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773546:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787614118.773557:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773582:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d438f5400 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:1.0:1787614118.773586:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773594:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787614118.773601:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614118.773607:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787614118.773609:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787614118.773620:0:17080:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:1.0:1787614118.773624:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773630:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5d438f5400/0x9719586bc2ef00fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef0105 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773647:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614118.773650:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773655:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149a400 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:1.0:1787614118.773658:0:17080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773664:0:17080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787614118.773677:0:17080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614118.773682:0:17080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787614118.773684:0:17080:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787614118.773701:0:17080:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:1.0:1787614118.773704:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614118.773711:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614118.773713:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614118.773715:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614118.773897:0:21064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787614118.773904:0:21064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a400/0x9719586bc2ef0462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef0469 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614118.773922:0:21064:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787614118.773927:0:21064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787614118.773929:0:21064:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787614118.773966:0:21064:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787614118.773971:0:21064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787614118.773976:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787614118.773983:0:21064:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787614118.773987:0:21064:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8b5d42ee0000) has no exports 00000020:00080000:3.0:1787614118.774010:0:21064:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8b5d42ee0000) has no exports 00010000:00010000:1.0:1787614118.776709:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787614118.778707:0:21064:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5d42e877e0 - data ffff8b5e651f5a20/ffff8b5d42df9800 00000020:01000000:3.0:1787614118.780063:0:21064:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5d4304e600 - data ffff8b5e651490d8/ffff8b5e7ae8d000 00100000:10000000:3.0:1787614118.800499:0:21064:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787614118.826279:0:21064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0113 00000020:00000080:1.0:1787614118.826291:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5e67acc000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787614118.826315:0:21064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d4332b000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787614118.826320:0:21064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d4332b000 2 00000020:01000004:1.0:1787614118.826323:0:21064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5d4332b000 from lustre-OST0000 00000020:00000080:1.0:1787614118.826351:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614118.826378:0:21064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787614118.826382:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5e536c0000/lustre-OST0000_UUID 00000020:00000080:1.0:1787614118.826384:0:21064:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e536c0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787614118.826391:0:21064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787614118.826461:0:21064:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787614118.826467:0:21064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787614118.826470:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614118.826476:0:21064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787614118.826485:0:21064:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8b5e4732d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787614118.826493:0:21064:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8b5e67b419b8) has exports, disconnecting them 00000020:00080000:1.0:1787614118.826512:0:21064:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8b5e4732d000), last request at 1787614035 00000020:00000080:1.0:1787614118.826517:0:21064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef013d 00000020:00080000:1.0:1787614118.826527:0:21064:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e4732d000): rc 0 00000020:00000080:1.0:1787614118.826533:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5e4732d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787614118.827072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e67acc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787614118.827085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4732d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787614118.831573:0:21064:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787614118.831715:0:21064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614118.831720:0:21064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787614118.831727:0:21064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787614118.831773:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e4732e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787614118.831940:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787614118.831948:0:21064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787614118.831953:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5d42c3c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787614118.831957:0:21064:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d42c3c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787614118.831963:0:21064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787614118.832022:0:21064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787614118.832025:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614118.832028:0:21064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787614118.832034:0:21064:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8b5e678e8800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787614118.832040:0:21064:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8b5e67b30000) has exports, disconnecting them 00000020:00080000:0.0:1787614118.832044:0:21064:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8b5e678e8800), last request at 1787614035 00000020:00000080:0.0:1787614118.832048:0:21064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0152 00000020:00080000:0.0:1787614118.832060:0:21064:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e678e8800): rc 0 00000020:00000080:0.0:1787614118.832064:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5e678e8800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787614118.832191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e678e8800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1787614118.838875:0:21064:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787614118.838883:0:21064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787614118.838887:0:21064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787614118.838893:0:21064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787614118.838924:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e678e9000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787614118.839116:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787614118.839126:0:21064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787614118.839131:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5e47328000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787614118.839135:0:21064:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e47328000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787614118.839141:0:21064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1787614118.839223:0:21064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d4332b000 1 00000020:00000080:2.0:1787614118.839229:0:21064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef00f0 00000020:00000080:2.0:1787614118.839235:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5e47ffc000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787614118.839244:0:21064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787614118.839251:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e47ffc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787614118.839259:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787614118.839264:0:21064:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787614118.839267:0:21064:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8b5d42ee4d28) has no exports 00010000:00010000:1.0:1787614118.899543:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787614118.904831:0:21064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787614118.904847:0:21064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787614118.904853:0:21064:0:(genops.c:885:class_export_put()) final put ffff8b5d4332c800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787614118.904857:0:21064:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d4332c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787614118.904870:0:21064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787614118.905014:0:21064:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b5d4332f000 00000020:02000400:2.0:1787614118.905063:0:21064:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1787614119.729458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787614119.729470:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614119.729474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787614119.729478:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787614119.729654:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692251776:0@lo:400:kworker.0 00000400:00000100:2.0:1787614119.729727:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251776 offset 0 length 224: 4 00010000:00010000:1.0:1787614119.925729:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614120.946312:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614121.970462:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614122.995879:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614123.892367:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614108/real 1787614108] req@ffff8b5e777f5500 x1874448692250880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787614123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614123.892394:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e777f5500 x1874448692250880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787614123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787614123.892549:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787614123.892575:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787614123.892579:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692250880:0@lo:38:kworker.0 00000100:00080000:0.0:1787614123.893044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787614123.893049:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614123.893052:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787614123.893066:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787614123.893069:0:8:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614123.893074:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 605 00000100:00080000:0.0:1787614123.893079:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787614123.893085:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b5d44020000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614123.893575:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c7b80 x1874448692251904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787614123.893628:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1874448692252032:0@lo:400:kworker.0 00000400:00000100:0.0:1787614123.893677:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692252032 offset 0 length 224: 4 00000100:00100000:3.0:1787614123.894976:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692251904:0@lo:38:kworker.0 00000400:00000100:3.0:1787614123.895012:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692251904 offset 0 length 520: 4 00000020:01000004:2.0:1787614123.930773:0:21267:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787614123.942417:0:21267:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787614123.942498:0:21267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614123.942512:0:21267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614123.942520:0:21267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614123.942526:0:21267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614123.942553:0:21267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787614123.942559:0:21267:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787614123.942583:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614123.942594:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e763c7b80 x1874448692251904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787614143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.942608:0:21267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787614123.942628:0:21267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787614123.942635:0:21267:0:(import.c:65:import_set_state_nolock()) ffff8b5d44020000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787614123.942640:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787614123.942645:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e763c7b80 x1874448692251904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787614143 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.942651:0:21267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787614123.942654:0:21267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00010000:00010000:3.0:1787614123.942786:0:17081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614123.942794:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614123.942802:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044e00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614123.942806:0:17081:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614123.942827:0:17081:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614123.942833:0:17081:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614123.942852:0:17081:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614123.942855:0:17081:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787614123.942857:0:17081:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787614123.942873:0:17081:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:3.0:1787614123.942877:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614123.942882:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e82044e00/0x9719586bc2ef028d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef0294 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614123.942894:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614123.942895:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614123.942897:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614123.942937:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692251904:0@lo:38:kworker.0 00000100:00080000:0.0:1787614123.944107:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787614123.944118:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f7100 x1874448692251008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614124 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.944134:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e48471180 x1874448692251264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614125 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.944151:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e763c5c00 x1874448692251392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614129 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.944180:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e48473100 x1874448692251648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614130 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.944189:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e763c4380 x1874448692251776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614123.944258:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692251648:0@lo:400:kworker.0 00000100:00100000:1.0:1787614123.947690:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692251392:0@lo:400:kworker.0 00000100:00100000:0.0:1787614123.948062:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e763c5880 x1874448692252032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614139 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614123.948076:0:21267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1787614123.948116:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1874448692252032:0@lo:400:kworker.0 00000100:00100000:3.0:1787614123.948177:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692251008:0@lo:400:kworker.0 00000100:00100000:1.0:1787614123.948387:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692251264:0@lo:400:kworker.0 00000100:00080000:0.0:1787614123.948446:0:21267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787614123.948474:0:21267:0:(import.c:65:import_set_state_nolock()) ffff8b5e51a93000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787614123.948653:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1874448692252160:0@lo:39:umount.0 00000400:00000100:1.0:1787614123.948701:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874448692252160 offset 0 length 224: 4 00000100:00100000:0.0:1787614123.949233:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692251776:0@lo:400:kworker.0 00010000:00010000:1.0:1787614124.022005:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614125.045059:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614126.065379:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614127.089594:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614128.113360:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787614128.945611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787614128.945621:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787614129.074499:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614114/real 1787614114] req@ffff8b5e48470a80 x1874448692251520/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787614129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614129.074542:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e48470a80 x1874448692251520/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787614129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787614129.074580:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787614129.074607:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787614129.074612:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3634:1874448692251520:0@lo:250:kworker.0 00000100:00080000:3.0:1787614129.074646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787614129.074652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787614129.074655:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614129.074660:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 611 00000100:00080000:3.0:1787614129.074666:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.155@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787614129.074683:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff8b5e6dec0000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614129.074717:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f7100 x1874448692252288/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787614129.074811:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3634:1874448692252288:0@lo:250:kworker.0 00000400:00000100:1.0:1787614129.074855:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874448692252288 offset 0 length 520: 4 00010000:00010000:3.0:1787614129.137495:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614130.163243:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614131.186282:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614132.209454:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614133.169299:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614123/real 1787614123] req@ffff8b5e763c5880 x1874448692252160/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787614133 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614133.169332:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e763c5880 x1874448692252160/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787614133 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787614133.169351:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e51a93000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787614133.169372:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1874448692252160:0@lo:39:umount.0 00000100:00080000:0.0:1787614133.169462:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787614133.169483:0:21267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787614133.169488:0:21267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787614133.170371:0:21267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170384:0:21267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170392:0:21267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170399:0:21267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170428:0:21267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614133.170436:0:21267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170444:0:21267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170450:0:21267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170455:0:21267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614133.170474:0:21267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787614133.170479:0:21267:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787614133.170502:0:21267:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787614133.170507:0:21267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787614133.170520:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787614133.170528:0:21267:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1787614133.170533:0:17081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1787614133.170534:0:21267:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8b5e67b44d28) has no exports 00010000:00010000:3.0:1787614133.170544:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170554:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7630be00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614133.170559:0:17081:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787614133.170559:0:21267:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8b5e67b44d28) has no exports 00010000:00010000:3.0:1787614133.170572:0:17081:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614133.170580:0:17081:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614133.170586:0:17081:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614133.170589:0:17081:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787614133.170592:0:17081:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787614133.170606:0:17081:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:3.0:1787614133.170610:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170616:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630be00/0x9719586bc2ef0263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef026a expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170632:0:17081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614133.170643:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170649:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149a600 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614133.170652:0:17081:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170658:0:17081:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614133.170664:0:17081:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614133.170669:0:17081:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787614133.170671:0:17081:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787614133.170673:0:17081:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787614133.170679:0:17081:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:3.0:1787614133.170682:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170687:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e4149a600/0x9719586bc2ef0454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2ef045b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.170700:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614133.170702:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614133.170703:0:17081:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787614133.172216:0:21267:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5d42e87180 - data ffff8b5e582e95e8/ffff8b5d42d07000 00010000:00010000:1.0:1787614133.172395:0:17080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787614133.175122:0:21267:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5d42e873c0 - data ffff8b5e582fc948/ffff8b5d4397c000 00100000:10000000:0.0:1787614133.182527:0:21267:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787614133.189571:0:21267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef0278 00000020:00000080:3.0:1787614133.189583:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5d423dd800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787614133.189601:0:21267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5e536c3000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787614133.189605:0:21267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5e536c3000 2 00000020:01000004:3.0:1787614133.189609:0:21267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5e536c3000 from lustre-OST0001 00000020:00000080:3.0:1787614133.189654:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787614133.189663:0:21267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787614133.189666:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5e4608a800/lustre-OST0001_UUID 00000020:00000080:3.0:1787614133.189669:0:21267:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e4608a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787614133.189675:0:21267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787614133.190382:0:21267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c94bd3a1-5d0d-4686-a524-bd5061ef9c4b->MGS 00010000:00010000:3.0:1787614133.190400:0:21267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a400/0x9719586bc2eeffbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eeffc3 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614133.190414:0:21267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a400/0x9719586bc2eeffbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eeffc3 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614133.190421:0:21267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787614133.190424:0:21267:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787614133.190428:0:21267:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787614133.190443:0:21267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:3.0:1787614133.190447:0:21267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630a400/0x9719586bc2eeffbc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2eeffc3 expref: -99 pid: 17824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614133.190463:0:21267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ac00/0x9719586bc2eefeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9719586bc2eefeb2 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614133.190470:0:21267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ac00/0x9719586bc2eefeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9719586bc2eefeb2 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614133.190476:0:21267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787614133.190478:0:21267:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787614133.190480:0:21267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787614133.190488:0:21267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5e6dec0000 00010000:00010000:3.0:1787614133.190491:0:21267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7630ac00/0x9719586bc2eefeab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9719586bc2eefeb2 expref: -99 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787614133.190520:0:21267:0:(import.c:65:import_set_state_nolock()) ffff8b5e6dec0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787614133.190525:0:21267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787614133.190527:0:21267:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787614133.190528:0:21267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787614133.190532:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787614133.190541:0:21267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5e777f7100 x1874448692252288/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787614149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787614133.190613:0:21267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787614133.190616:0:21267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000020:00000080:0.0:1787614133.190792:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d423dd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787614133.193566:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c94bd3a1-5d0d-4686-a524-bd5061ef9c4b:3634:1874448692252288:0@lo:250:kworker.0 10000000:01000000:3.0:1787614133.193936:0:21267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787614133.193949:0:21267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2eefe96 00000020:00000080:3.0:1787614133.193957:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5d43b94800/c94bd3a1-5d0d-4686-a524-bd5061ef9c4b 00000020:01000000:3.0:1787614133.193974:0:21267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.155@tcp (flags='') 00000020:00000080:3.0:1787614133.193982:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787614133.193990:0:21267:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787614133.193994:0:21267:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8b5d432e19b8) has no exports 10000000:01000000:1.0:1787614133.194272:0:17089:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787614133.194381:0:21267:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.155@tcp: client import never connected 00000100:00080000:3.0:1787614133.194385:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787614133.194387:0:21267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787614133.194390:0:21267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787614133.194392:0:21267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787614133.194426:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787614133.194432:0:21267:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.155@tcp (uuid c94bd3a1-5d0d-4686-a524-bd5061ef9c4b) 00000020:01000000:3.0:1787614133.194438:0:21267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787614133.194441:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787614133.194445:0:21267:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787614133.194450:0:21267:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8b5d44025000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787614133.194455:0:21267:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8b5e7afb4d28) has exports, disconnecting them 00000020:00080000:3.0:1787614133.194458:0:21267:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8b5d44025000), last request at 1787614052 00000020:00000080:3.0:1787614133.194462:0:21267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef02a2 00000020:00080000:3.0:1787614133.194486:0:21267:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5d44025000): rc 0 00000020:00000080:3.0:1787614133.194490:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5d44025000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787614133.194655:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d43b94800/c94bd3a1-5d0d-4686-a524-bd5061ef9c4b for MGC192.168.206.155@tcp 00000020:00000080:0.0:1787614133.194664:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e6dec0000 for MGC192.168.206.155@tcp 00000020:00000080:0.0:1787614133.194670:0:8:0:(genops.c:885:class_export_put()) final put ffff8b5e6dec2800/c94bd3a1-5d0d-4686-a524-bd5061ef9c4b 00000020:00000080:0.0:1787614133.194672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e6dec2800/c94bd3a1-5d0d-4686-a524-bd5061ef9c4b for MGC192.168.206.155@tcp 00000020:01000000:0.0:1787614133.194676:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.155@tcp (c94bd3a1-5d0d-4686-a524-bd5061ef9c4b) 00000020:00000080:1.0:1787614133.195150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d44025000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787614133.216387:0:21267:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787614133.216395:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787614133.216399:0:21267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787614133.216407:0:21267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787614133.216605:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614133.216613:0:21267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1787614133.216620:0:21267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787614133.216635:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614133.216640:0:21267:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787614133.216648:0:21267:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8b5e678ef000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787614133.216655:0:21267:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8b5e7afb19b8) has exports, disconnecting them 00000020:00080000:1.0:1787614133.216660:0:21267:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8b5e678ef000), last request at 1787614052 00000020:00000080:1.0:1787614133.216665:0:21267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef02b7 00000020:00080000:1.0:1787614133.216681:0:21267:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5e678ef000): rc 0 00000020:00000080:1.0:1787614133.216688:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5e678ef000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787614133.217471:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5d44020000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787614133.217480:0:8:0:(genops.c:885:class_export_put()) final put ffff8b5d44027800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787614133.217483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d44027800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787614133.217491:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787614133.217558:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e678ef000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787614133.220039:0:21267:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787614133.220047:0:21267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787614133.220052:0:21267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787614133.220059:0:21267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787614133.220094:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5e51a93000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787614133.222538:0:17081:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787614133.312002:0:17080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1787614133.317613:0:17076:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8b5e76010400:17076] 1 exiting: rc = 0 00000100:00100000:1.0:1787614133.317765:0:17075:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8b5e76011e00:17075] 0 exiting: rc = 1 00000100:00100000:0.0:1787614133.327504:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614133.327917:0:17078:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8b5e76010800:17078] 1 exiting: rc = 0 00000100:00100000:3.0:1787614133.327932:0:19430:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8b5d42c18c00:19430] 3 exiting: rc = 0 00000100:00100000:1.0:1787614133.328017:0:17077:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8b5e70b3b400:17077] 0 exiting: rc = 1 00000100:00100000:0.0:1787614133.328234:0:17079:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8b5e76010600:17079] 2 exiting: rc = 0 00000100:00100000:1.0:1787614133.332135:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332145:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332153:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332175:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332183:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332190:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332196:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332202:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332207:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332213:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332218:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332223:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332228:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332233:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332238:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332243:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332248:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332253:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332258:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332263:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332297:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332302:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332309:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332314:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332319:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332324:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332330:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332336:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332341:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332348:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332353:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332358:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332363:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332368:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332373:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332378:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332383:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332388:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332394:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332400:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332405:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332414:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332420:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332425:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332431:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332436:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332441:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332446:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332451:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332456:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332462:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332468:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332474:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.332478:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333609:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333634:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333645:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333651:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333656:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333661:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333667:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333672:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333677:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.333683:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787614133.334410:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787614133.334419:0:21267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787614133.334424:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5d44023000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787614133.334429:0:21267:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5d44023000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787614133.334436:0:21267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787614133.334475:0:21267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5e536c3000 1 00000020:00000080:1.0:1787614133.334480:0:21267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9719586bc2ef025c 00000020:00000080:1.0:1787614133.334486:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5e46088800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787614133.334496:0:21267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787614133.334499:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787614133.334503:0:21267:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787614133.334507:0:21267:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8b5e67b40000) has no exports 00000020:00000080:0.0:1787614133.335028:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e46088800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787614133.407741:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787614133.407753:0:21267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787614133.407759:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5e536c1800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787614133.407763:0:21267:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e536c1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787614133.407778:0:21267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787614133.409730:0:21267:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b5e536c4000 00000020:01000000:3.0:1787614133.409760:0:21267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787614133.409767:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787614133.409772:0:21267:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787614133.409776:0:21267:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8b5e7afb0000) has no exports 00000020:00000080:3.0:1787614133.409807:0:21267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787614133.409815:0:21267:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787614133.409819:0:21267:0:(genops.c:885:class_export_put()) final put ffff8b5e47ffd000/OSS_uuid 00000020:00000080:3.0:1787614133.409822:0:21267:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5e47ffd000/OSS_uuid for OSS 00000020:01000000:3.0:1787614133.409826:0:21267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787614133.409885:0:17088:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787614133.410069:0:18598:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8b5e473b2c00:18598] 0 exiting: rc = 1 00000100:00100000:2.0:1787614133.410193:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8b5d42ec8200:18599] 1 exiting: rc = 0 00000100:00100000:1.0:1787614133.410305:0:18601:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8b5e7aed3c00:18601] 2 exiting: rc = 0 00000100:00100000:1.0:1787614133.410357:0:19016:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8b5d41cfe600:19016] 3 exiting: rc = 0 00000100:00100000:3.0:1787614133.413849:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413861:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413866:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413871:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413877:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413882:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413887:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413892:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413897:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413902:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413907:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413912:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413917:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413922:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413927:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413949:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413953:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413957:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413962:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413967:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413971:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413976:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413981:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413985:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413990:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.413996:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414001:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414006:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414013:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414018:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414023:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414028:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414034:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414038:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414043:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414048:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414052:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414058:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414063:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414067:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414071:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414076:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414081:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414087:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414091:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414096:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414100:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414105:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414111:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414116:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414128:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414133:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414138:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414143:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414148:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414153:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414190:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414197:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414204:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414212:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414230:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414237:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414244:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787614133.414251:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787614133.417726:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8b5e7c270a00:18602] 0 exiting: rc = 1 00000100:00100000:3.0:1787614133.417998:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8b5d4323e400:18603] 1 exiting: rc = 0 00000100:00100000:2.0:1787614133.421002:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421020:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421026:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421031:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421036:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421041:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421047:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421052:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421057:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421063:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421068:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421073:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421078:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421083:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421089:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421093:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421098:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421103:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421108:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421113:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421118:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.421998:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422019:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422025:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422030:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422036:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422041:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422045:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422063:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422069:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422074:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422079:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422085:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422090:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422096:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422101:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422106:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422112:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422118:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422123:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422128:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422133:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422138:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422143:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422148:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422154:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422183:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422191:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422202:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422208:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422213:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422217:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422222:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422227:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422232:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422237:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422242:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422247:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422252:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422256:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422261:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422266:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422271:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.422300:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.424238:0:20232:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8b5d42c57400:20232] 3 exiting: rc = 0 00000100:00100000:3.0:1787614133.424315:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8b5e7af9fe00:18604] 0 exiting: rc = 1 00000100:00100000:3.0:1787614133.424477:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8b5e678f3800:18606] 2 exiting: rc = 0 00000100:00100000:0.0:1787614133.425371:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8b5e51ebb600:18605] 1 exiting: rc = 0 00000100:00100000:2.0:1787614133.425618:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425626:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425631:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425637:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425661:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425725:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425732:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425737:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425743:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425748:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425753:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425758:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425763:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425768:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425773:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425778:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425784:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425802:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425808:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425813:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425818:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425823:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425828:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425833:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425838:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425844:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425848:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425854:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425859:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425865:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425872:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425877:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425886:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425892:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425907:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425912:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425917:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425922:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425927:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425932:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425937:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425956:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425962:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425967:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425973:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425978:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425983:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425988:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425994:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.425999:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426004:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426009:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426014:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426020:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426025:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426030:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426035:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426050:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426058:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426063:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426068:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426081:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426088:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.426093:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.436309:0:18607:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8b5e59422600:18607] 0 exiting: rc = 1 00000100:00100000:1.0:1787614133.436404:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8b5e707c6e00:18608] 1 exiting: rc = 0 00000100:00100000:2.0:1787614133.441292:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441303:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441310:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441315:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441319:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441339:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441344:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441349:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441354:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441385:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441392:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441397:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441402:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441408:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441412:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441417:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441423:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441429:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441435:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441440:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441445:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441450:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441456:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441461:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441467:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441473:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441477:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441495:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441501:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441506:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441511:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441516:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441522:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441527:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441532:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441538:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441543:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441548:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441554:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441559:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441572:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441578:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441583:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441589:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441594:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441600:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441606:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441611:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441616:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441622:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441627:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441632:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441638:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441642:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441648:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441653:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441658:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441664:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441669:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441675:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441681:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441686:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441691:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.441702:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787614133.442696:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8b5e591d3600:18609] 0 exiting: rc = 1 00000100:00100000:1.0:1787614133.442824:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8b5e7af3d200:18610] 1 exiting: rc = 0 00000100:00100000:2.0:1787614133.443371:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443380:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443386:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443394:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443400:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443406:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443413:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443418:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443444:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443452:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443458:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.443475:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444400:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444414:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444419:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444425:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444431:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444437:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444443:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444449:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444471:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.444478:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449608:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449623:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449630:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449636:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449641:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449646:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449653:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449658:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449664:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449670:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449700:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449709:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449714:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449720:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449725:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449731:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449736:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449742:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449748:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449754:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449759:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449765:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449787:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449793:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449813:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449818:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449824:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449830:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449837:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449843:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449848:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449854:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449858:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449864:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449884:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449891:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449895:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449901:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449906:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449918:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449932:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787614133.449946:0:21267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787614133.470925:0:21267:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787614154.073865:0:22034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787614164.566494:0:22634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787614164.566500:0:22634:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787614164.566502:0:22634:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787614164.566618:0:22634:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b5e7af67800 00000020:01000004:2.0:1787614164.566638:0:22634:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787614164.566645:0:22634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787614164.566659:0:22634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8b5e7afb0000) 00000020:00000080:2.0:1787614164.566674:0:22634:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787614164.712806:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787614164.722240:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787614164.724867:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787614164.725380:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787614164.725652:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787614164.726855:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787614164.727290:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787614164.727535:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787614164.727855:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787614164.728331:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787614164.728585:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787614164.728851:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787614164.729383:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787614164.729600:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787614164.731141:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787614164.732307:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787614164.734145:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787614164.739534:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787614164.741058:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787614164.744085:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787614164.744664:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787614164.744995:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787614164.745753:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787614164.746207:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787614164.747123:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787614164.748238:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787614164.759441:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.760336:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.760639:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787614164.760909:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.762626:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787614164.763041:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.763295:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.763531:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787614164.765198:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.766926:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.767388:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787614164.770868:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787614164.771336:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787614164.771596:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787614164.772066:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787614164.772383:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1787614164.772933:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787614164.773205:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787614164.773607:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787614164.775707:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787614164.783739:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787614164.799139:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787614164.800152:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787614164.800599:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787614164.803773:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787614164.805095:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787614164.805390:0:22634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1787614164.807615:0:22634:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787614164.808535:0:22634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787614164.808544:0:22634:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787614164.808556:0:22634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef0702 00000020:01000004:1.0:1787614164.808563:0:22634:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787614164.808567:0:22634:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787614164.808572:0:22634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5e7af67800 from MGS 00000020:01000004:1.0:1787614164.808576:0:22634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787614164.808588:0:22634:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8b5d4208b370) 00000020:00000080:1.0:1787614164.808599:0:22634:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787614164.808660:0:22634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5e7af67800 from MGS, refs=2 00080000:01000000:1.0:1787614164.808665:0:22634:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787614164.808670:0:22634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef0710 00000100:00100000:1.0:1787614164.808792:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787614164.809377:0:22634:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787614164.809384:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787614164.810869:0:22634:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787614164.810878:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787614164.812745:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787614164.813323:0:22634:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787614164.813329:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787614164.817423:0:22634:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787614164.817438:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787614164.819399:0:22634:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787614164.819411:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787614164.846227:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614164.846234:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614164.846237:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614164.847479:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614164.847484:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614164.847486:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614164.848339:0:22634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787614164.856185:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787614164.861327:0:22634:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787614164.868294:0:22646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787614164.872352:0:22634:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787614164.872411:0:22634:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787614164.873270:0:22634:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787614164.873959:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787614164.874139:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787614164.874146:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787614164.875556:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787614164.875565:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787614164.875994:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787614164.876000:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787614164.876937:0:22634:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787614164.876960:0:22634:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.155@tcp' 00000020:01000004:2.0:1787614164.876963:0:22634:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787614164.876994:0:22634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.155@tcp (typ=mgc) 00000020:00000080:2.0:1787614164.877007:0:22634:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.155@tcp (ffff8b5e7afb19b8) 00000020:00000080:2.0:1787614164.877024:0:22634:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787614164.877105:0:22634:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5d43bf1800@MGC192.168.206.155@tcp: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1787614164.877276:0:22634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.155@tcp-0 is initialized 00000040:01000000:2.0:1787614164.877282:0:22634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787614164.877480:0:22651:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787614164.878871:0:22652:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787614164.878945:0:22634:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.155@tcp (uuid 40bd2766-3e74-4d8d-ab12-1e4ea932a3ed) 00000020:00000080:0.0:1787614164.878969:0:22634:0:(genops.c:1385:class_connect()) connect: client 40bd2766-3e74-4d8d-ab12-1e4ea932a3ed, cookie 0x9719586bc2ef071e 00000100:00080000:0.0:1787614164.878980:0:22634:0:(import.c:510:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787614164.878986:0:22634:0:(import.c:624:import_select_connection()) MGC192.168.206.155@tcp: import ffff8b5d43bf1800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614164.879017:0:22634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c4380 x1874448692252416/t0(0) o250->MGC192.168.206.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614164.879048:0:22634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 40bd2766-3e74-4d8d-ab12-1e4ea932a3ed->MGS 00000020:01000004:0.0:1787614164.879073:0:22634:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787614164.879078:0:22634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787614164.879093:0:22634:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8b5e67b34d28) 00000020:00000080:0.0:1787614164.879104:0:22634:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787614164.879759:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3634:1874448692252416:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787614164.879823:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614164.879900:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692252416 00000100:00100000:2.0:1787614164.879908:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692252416 00000100:00100000:2.0:1787614164.879942:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787614164.879949:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1874448692252416:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787614164.879971:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 40bd2766-3e74-4d8d-ab12-1e4ea932a3ed@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1787614164.879994:0:22648:0:(genops.c:1385:class_connect()) connect: client 40bd2766-3e74-4d8d-ab12-1e4ea932a3ed, cookie 0x9719586bc2ef072c 00000100:00080000:2.0:1787614164.880124:0:22648:0:(import.c:65:import_set_state_nolock()) ffff8b5d43bf1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614164.880190:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:3634:x1874448692252416:12345-0@lo:250:mount.lustre.0 Request processed in 239us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614164.880197:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787614164.880236:0:3634:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787614164.880244:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.155@tcp: connect to target with instance 0 00000100:00080000:2.0:1787614164.880251:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787614164.880255:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787614164.880258:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d43bf1800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787614164.880266:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787614164.880273:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787614164.880278:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3634:1874448692252416:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787614164.901295:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787614164.901485:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787614164.901491:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787614164.904357:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787614164.904760:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787614164.906885:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787614164.906896:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787614164.907651:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787614164.907849:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787614164.907855:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787614164.908612:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787614164.908620:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787614165.004928:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787614165.005850:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787614165.005859:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787614165.013620:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787614165.013654:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787614165.015452:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787614165.015961:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787614165.015967:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787614165.026263:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787614165.026278:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787614165.031015:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787614165.031242:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787614165.031247:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787614165.036993:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787614165.037015:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787614165.038284:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787614165.038466:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787614165.038472:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787614165.041424:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787614165.041438:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787614165.089020:0:22634:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787614165.089925:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787614165.089933:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787614165.095283:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787614165.095298:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787614165.100592:0:22634:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787614165.100615:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787614165.102120:0:22634:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787614165.102150:0:22634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787614165.102296:0:22634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787614165.102404:0:22634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787614165.102441:0:22634:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.155@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787614165.102446:0:22634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787614165.102447:0:22634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787614165.102449:0:22634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614165.102450:0:22634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614165.102451:0:22634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614165.102452:0:22634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614165.102454:0:22634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787614165.102456:0:22634:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787614165.102457:0:22634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614165.102459:0:22634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787614165.102461:0:22634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787614165.102463:0:22634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787614165.102464:0:22634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787614165.102466:0:22634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614165.102470:0:22634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614165.102471:0:22634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614165.102473:0:22634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614165.102474:0:22634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787614165.102475:0:22634:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787614165.103036:0:22634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614165.103037:0:22634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787614165.103065:0:22634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787614165.103084:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787614165.104270:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.104310:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e44fd7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787614165.104857:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692252544 00000100:00100000:0.0:1787614165.104868:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692252544 00000100:00100000:0.0:1787614165.105843:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787614165.105860:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:22634:x1874448692252544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787614165.105918:0:22650:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787614165.105921:0:22650:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787614165.105924:0:22650:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787614165.108728:0:22671:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787614165.109700:0:22650:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787614165.111810:0:22672:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787614165.111817:0:22672:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787614165.111821:0:22672:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787614165.111823:0:22672:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787614165.112032:0:22672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787614165.112286:0:22650:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787614165.112296:0:22650:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787614165.114934:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:22634:x1874448692252544:12345-0@lo:253:mount.lustre.0 Request processed in 9071us (10657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614165.114954:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787614165.115029:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787614165.115044:0:22634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787614165.115047:0:22634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787614165.115048:0:22634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787614165.115049:0:22634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614165.115051:0:22634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614165.115052:0:22634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614165.115053:0:22634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614165.115054:0:22634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787614165.115056:0:22634:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787614165.115058:0:22634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614165.115059:0:22634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787614165.115078:0:22634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5e7af67800 from lustre-MDT0000 10000000:01000000:2.0:1787614165.115105:0:22634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787614165.115120:0:22634:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787614165.115124:0:22634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8b5e7afb19b8 10000000:01000000:2.0:1787614165.115129:0:22634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787614165.115137:0:22634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8b5e7afb19b8 from 1 10000000:01000000:2.0:1787614165.115139:0:22634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787614165.115271:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.115283:0:22634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.115309:0:22634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614165.115327:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787614165.115362:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.115387:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787614165.115452:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692252672 00000100:00100000:0.0:1787614165.115458:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692252672 00000100:00100000:0.0:1787614165.115524:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787614165.115535:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:22634:x1874448692252672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787614165.115547:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614165.115561:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e40030000/0x9719586bc2ef073a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0733 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.115580:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e40030000/0x9719586bc2ef073a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0733 expref: 6 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.115590:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e40030000/0x9719586bc2ef073a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0733 expref: 6 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.115599:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e40030000, rc 0) 00000100:00100000:0.0:1787614165.115653:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+6:22634:x1874448692252672:12345-0@lo:101:mount.lustre.0 Request processed in 120us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614165.115659:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787614165.115728:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614165.115742:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.115751:0:22634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614165.115812:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614165.115837:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.116192:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.116380:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692252800 00000100:00100000:3.0:1787614165.116393:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692252800 00000100:00100000:3.0:1787614165.116418:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787614165.116424:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+6:22634:x1874448692252800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614165.116499:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+6:22634:x1874448692252800:12345-0@lo:501:mount.lustre.0 Request processed in 74us (660us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787614165.116505:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787614165.116578:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787614165.116606:0:22634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787614165.116624:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.116645:0:22634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614165.116653:0:22634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5e7af67800 10000000:01000000:2.0:1787614165.116657:0:22634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787614165.116667:0:22634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b5e7af67800 10000000:01000000:2.0:1787614165.116670:0:22634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787614165.116673:0:22634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8b5e7af67800 from 1 10000000:01000000:2.0:1787614165.116675:0:22634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787614165.116696:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.116703:0:22634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.116711:0:22634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614165.116734:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787614165.116763:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.116783:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.117026:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692252928 00000100:00100000:3.0:1787614165.117031:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692252928 00000100:00100000:3.0:1787614165.117052:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787614165.117057:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+6:22634:x1874448692252928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614165.117067:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614165.117082:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f0600/0x9719586bc2ef0748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0741 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.117098:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f0600/0x9719586bc2ef0748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0741 expref: 7 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.117122:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f0600/0x9719586bc2ef0748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0741 expref: 7 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.117130:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f0600, rc 0) 00000100:00100000:3.0:1787614165.117185:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+7:22634:x1874448692252928:12345-0@lo:101:mount.lustre.0 Request processed in 127us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.117191:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787614165.117266:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692252928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614165.117278:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0748 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.117288:0:22634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0748 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614165.117299:0:22634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787614165.117316:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0748 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.117323:0:22634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99200/0x9719586bc2ef0741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0748 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614165.117343:0:22634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787614165.117346:0:22634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787614165.117351:0:22634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b5e7af67800 10000000:01000000:2.0:1787614165.117354:0:22634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787614165.117357:0:22634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787614165.117359:0:22634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787614165.117375:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.117382:0:22634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.117389:0:22634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614165.117402:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692253056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787614165.117425:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.117443:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.117498:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692253056 00000100:00100000:3.0:1787614165.117503:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692253056 00000100:00100000:3.0:1787614165.117520:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787614165.117526:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+7:22634:x1874448692253056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614165.117541:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614165.117549:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f1600/0x9719586bc2ef0756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef074f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.117563:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f1600/0x9719586bc2ef0756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef074f expref: 8 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.117571:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f1600/0x9719586bc2ef0756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef074f expref: 8 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.117577:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f1600, rc 0) 00000100:00100000:3.0:1787614165.117610:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+8:22634:x1874448692253056:12345-0@lo:101:mount.lustre.0 Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.117617:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614165.117855:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692253056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614165.117866:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0756 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.117874:0:22634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0756 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614165.117921:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692253184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614165.117947:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.117964:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.118012:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692253184 00000100:00100000:3.0:1787614165.118016:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692253184 00000100:00100000:3.0:1787614165.118032:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787614165.118038:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+8:22634:x1874448692253184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614165.118240:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22634:x1874448692253184:12345-0@lo:501:mount.lustre.0 Request processed in 201us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.118247:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787614165.118492:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692253184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614165.118520:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692253312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614165.118566:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.118595:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.118853:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692253312 00000100:00100000:3.0:1787614165.118858:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692253312 00000100:00100000:3.0:1787614165.118892:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787614165.118899:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22634:x1874448692253312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614165.127130:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22634:x1874448692253312:12345-0@lo:503:mount.lustre.0 Request processed in 8221us (8555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614165.127145:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787614165.127210:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692253312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787614165.131979:0:22673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22673:1874448692253440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787614165.132073:0:22673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614165.132129:0:22673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db3240 going to sleep for 11 seconds 00000100:00100000:2.0:1787614165.132386:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692253440 00000100:00100000:2.0:1787614165.132393:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692253440 00000100:00100000:2.0:1787614165.132441:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787614165.132450:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22673:x1874448692253440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787614165.134487:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22673:x1874448692253440:12345-0@lo:502:llog_process_th.0 Request processed in 2028us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614165.134501:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787614165.135264:0:22673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22673:1874448692253440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787614165.135304:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787614165.135317:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787614165.135319:0:22673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787614165.135324:0:22673:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787614165.135328:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787614165.135346:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8b5e67b33370) 00000020:00000080:0.0:1787614165.135365:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787614165.135369:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787614165.135450:0:22673:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787614165.135456:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef0764 00000020:00000080:0.0:1787614165.135936:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787614165.135943:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787614165.135947:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787614165.135949:0:22673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787614165.135952:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787614165.135956:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787614165.135957:0:22673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787614165.135961:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787614165.135969:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8b5e67b319b8) 00000020:00000080:0.0:1787614165.135981:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787614165.135985:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787614165.135986:0:22673:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787614165.135989:0:22673:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787614165.135995:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787614165.136046:0:22673:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5e7af67800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787614165.136060:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8b5e67b30000) 00000020:00000080:0.0:1787614165.136077:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787614165.136153:0:22673:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787614165.136199:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef0779 00000020:00000080:0.0:1787614165.136300:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787614165.136306:0:22673:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787614165.136311:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9719586bc2ef0780 00080000:01000000:0.0:1787614165.136317:0:22673:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787614165.136321:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef0787 00010000:00010000:2.0:1787614165.243970:0:22673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787614165.245218:0:22673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1787614165.245540:0:22673:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787614165.246307:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8b5e7afb4d28) 00000020:00000080:2.0:1787614165.246323:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787614165.246407:0:22673:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787614165.246414:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef0795 00000020:00000080:2.0:1787614165.247436:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787614165.255596:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9719586bc2ef079c 00000020:00000080:3.0:1787614165.255964:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787614165.255975:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614165.255987:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.255989:0:22673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787614165.255992:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787614165.255995:0:22673:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787614165.255996:0:22673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787614165.255998:0:22673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787614165.255999:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787614165.256002:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.256003:0:22673:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787614165.256006:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614165.256010:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.256011:0:22673:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787614165.256015:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787614165.256054:0:22673:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787614165.256067:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614165.256071:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.256073:0:22673:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787614165.256075:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614165.256078:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.256080:0:22673:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787614165.256083:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787614165.256087:0:22673:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:00000080:3.0:1787614165.256135:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787614165.256150:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8b5e67b40000) 00000020:00000080:3.0:1787614165.256196:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787614165.256202:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787614165.256258:0:22673:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787614165.256264:0:22673:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787614165.256270:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef07aa 00010000:00080000:3.0:1787614165.256300:0:22673:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e48346000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:3.0:1787614165.258612:0:22673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787614165.261979:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787614165.261993:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787614165.262023:0:22673:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787614165.262042:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef07b1 00000100:00080000:1.0:1787614165.262051:0:22673:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787614165.262056:0:22673:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8b5e48346000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1787614165.262087:0:22673:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e76149180 x1874448692253568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787614165.262126:0:22673:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787614165.262242:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614165.262246:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614165.262247:0:22673:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787614165.262250:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787614165.262252:0:22673:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787614165.262254:0:22673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787614165.262255:0:22673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787614165.262256:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787614165.262258:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614165.262259:0:22673:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787614165.262262:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787614165.262266:0:22673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787614165.262269:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614165.262270:0:22673:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787614165.262273:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787614165.262276:0:22673:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:1.0:1787614165.262299:0:22673:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787614165.262307:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787614165.262318:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8b5d42088000) 00000020:00000080:1.0:1787614165.262329:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787614165.262333:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787614165.262394:0:22673:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787614165.262400:0:22673:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787614165.262405:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef07bf 00010000:00080000:1.0:1787614165.262433:0:22673:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e4608e800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1787614165.262614:0:22673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787614165.263369:0:22673:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787614165.263543:0:22673:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787614165.263787:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692253568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787614165.263874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.263955:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692253568 00000100:00100000:3.0:1787614165.263964:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692253568 00000100:00100000:3.0:1787614165.263994:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787614165.264001:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1874448692253568:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787614165.264017:0:22660:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:1.0:1787614165.268926:0:22673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614165.269138:0:22673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787614165.279545:0:22673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1787614165.282393:0:22679:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787614165.282399:0:22679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787614165.291918:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787614165.291932:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787614165.291987:0:22673:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787614165.292005:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef07c6 00000100:00080000:2.0:1787614165.292014:0:22673:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787614165.292020:0:22673:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b5e4608e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614165.292057:0:22673:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48470000 x1874448692253696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787614165.292085:0:22673:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787614165.292176:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614165.292180:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.292182:0:22673:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787614165.292185:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787614165.292188:0:22673:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787614165.292189:0:22673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787614165.292191:0:22673:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787614165.292192:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787614165.292194:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.292196:0:22673:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787614165.292198:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787614165.292201:0:22673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787614165.292204:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.292206:0:22673:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787614165.292208:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787614165.292212:0:22673:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:2.0:1787614165.292235:0:22673:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787614165.292237:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787614165.292247:0:22673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8b5e7afb3370) 00000020:00000080:2.0:1787614165.292259:0:22673:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787614165.292262:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787614165.292315:0:22673:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787614165.292323:0:22673:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787614165.292328:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9719586bc2ef07d4 00010000:00080000:2.0:1787614165.292355:0:22673:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e67931800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1787614165.292908:0:22673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787614165.292967:0:22673:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787614165.292980:0:22673:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787614165.297300:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692253696:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787614165.297363:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692253696 offset 0 length 520: 4 00000100:00100000:3.0:1787614165.298015:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1874448692253568:12345-0@lo:38:llog_process_th.0 Request processed in 34011us (34138us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787614165.298026:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787614165.298268:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787614165.298273:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787614165.298276:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692253568:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787614165.299234:0:22673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787614165.300006:0:22673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787614165.300185:0:22673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1787614165.301057:0:22681:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787614165.301063:0:22681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787614165.308976:0:22673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787614165.308993:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787614165.309041:0:22673:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787614165.309061:0:22673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef07db 00000100:00080000:3.0:1787614165.309071:0:22673:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787614165.309076:0:22673:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b5e67931800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614165.309122:0:22673:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f4e00 x1874448692253824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787614165.309211:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692253824:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787614165.309265:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692253824 offset 0 length 520: 4 00000100:00080000:3.0:1787614165.309378:0:22673:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787614165.309464:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614165.309468:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.309470:0:22673:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787614165.309473:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614165.309476:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.309484:0:22673:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787614165.309488:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787614165.309489:0:22673:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787614165.309492:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614165.309493:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.309494:0:22673:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787614165.309497:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614165.309499:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.309500:0:22673:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787614165.309504:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787614165.309535:0:22673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22673:1874448692253952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787614165.309585:0:22673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.309607:0:22673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.309657:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692253952 00000100:00100000:3.0:1787614165.309663:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692253952 00000100:00100000:3.0:1787614165.309697:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787614165.309705:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22673:x1874448692253952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787614165.311442:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22673:x1874448692253952:12345-0@lo:502:llog_process_th.0 Request processed in 1731us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.311453:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787614165.311517:0:22673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22673:1874448692253952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787614165.311543:0:22673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614165.311549:0:22673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614165.311551:0:22673:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787614165.311555:0:22673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787614165.311980:0:22634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787614165.312003:0:22634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787614165.312016:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0756 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312041:0:22634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98400/0x9719586bc2ef074f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0756 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614165.312049:0:22634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e7af67800 from 1 10000000:01000000:3.0:1787614165.312051:0:22634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787614165.312080:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312088:0:22634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312097:0:22634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.312124:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614165.312183:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.312205:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.312313:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254080 00000100:00100000:3.0:1787614165.312320:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254080 00000100:00100000:3.0:1787614165.312350:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787614165.312358:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+9:22634:x1874448692254080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614165.312369:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614165.312381:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef07e2 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312401:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 10 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312421:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 10 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312430:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f0200, rc 0) 00000100:00100000:3.0:1787614165.312456:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+10:22634:x1874448692254080:12345-0@lo:101:mount.lustre.0 Request processed in 98us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.312462:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787614165.312493:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614165.312504:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.312512:0:22634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.313243:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254208:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787614165.313282:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.313299:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.313318:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254208 00000100:00100000:3.0:1787614165.313322:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254208 00000100:00100000:3.0:1787614165.313350:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787614165.313357:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+10:22634:x1874448692254208:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787614165.313370:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787614165.313376:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787614165.313432:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+10:22634:x1874448692254208:12345-0@lo:256:mount.lustre.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.313438:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787614165.313479:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254208:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787614165.314723:0:22634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787614165.314750:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.314761:0:22634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614165.314769:0:22634:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5e7af67800 from 1 10000000:01000000:3.0:1787614165.314772:0:22634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787614165.314807:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.314826:0:22634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.314837:0:22634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.314857:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614165.314904:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.314943:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787614165.315016:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254336 00000100:00100000:1.0:1787614165.315022:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254336 00000100:00100000:1.0:1787614165.315064:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787614165.315073:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+10:22634:x1874448692254336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614165.315082:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614165.315094:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef07f0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614165.315122:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 11 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614165.315131:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 11 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614165.315138:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41669000, rc 0) 00000100:00100000:1.0:1787614165.315189:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22634:x1874448692254336:12345-0@lo:101:mount.lustre.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614165.315205:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787614165.315473:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614165.315487:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.315495:0:22634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.315558:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614165.315584:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.315609:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787614165.315698:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254464 00000100:00100000:1.0:1787614165.315704:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254464 00000100:00100000:1.0:1787614165.315738:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787614165.315745:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22634:x1874448692254464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614165.315871:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22634:x1874448692254464:12345-0@lo:501:mount.lustre.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614165.315877:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787614165.316028:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614165.316056:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614165.316096:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.316123:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.316137:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254592 00000100:00100000:3.0:1787614165.316140:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254592 00000100:00100000:3.0:1787614165.316187:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787614165.316195:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22634:x1874448692254592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614165.316269:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22634:x1874448692254592:12345-0@lo:503:mount.lustre.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.316275:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787614165.316314:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614165.316787:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22683:1874448692254720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787614165.316838:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614165.316866:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e7b33c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.317026:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254720 00000100:00100000:3.0:1787614165.317032:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254720 00000100:00100000:3.0:1787614165.317066:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787614165.317074:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22683:x1874448692254720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787614165.317542:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22683:x1874448692254720:12345-0@lo:502:llog_process_th.0 Request processed in 467us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.317549:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787614165.317656:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22683:1874448692254720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787614165.317683:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614165.317692:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317695:0:22683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787614165.317701:0:22683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5e7af67800 00000020:00000080:2.0:1787614165.317704:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614165.317711:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614165.317725:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317726:0:22683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787614165.317729:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614165.317732:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317733:0:22683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787614165.317737:0:22683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5e7af67800 00000020:00000080:2.0:1787614165.317739:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614165.317792:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614165.317796:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317797:0:22683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787614165.317800:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614165.317802:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317804:0:22683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787614165.317807:0:22683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5e7af67800 00000020:00000080:2.0:1787614165.317825:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614165.317844:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614165.317848:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317849:0:22683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787614165.317851:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614165.317854:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.317856:0:22683:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787614165.317860:0:22683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5e7af67800 00000020:00000080:2.0:1787614165.317862:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787614165.317899:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22683:1874448692254848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787614165.317936:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.317959:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e45f7d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787614165.321358:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254848 00000100:00100000:0.0:1787614165.321373:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254848 00000100:00100000:0.0:1787614165.321430:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787614165.321441:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22683:x1874448692254848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787614165.321609:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22683:x1874448692254848:12345-0@lo:502:llog_process_th.0 Request processed in 169us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614165.321616:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787614165.324862:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22683:1874448692254848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787614165.324906:0:22683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614165.324914:0:22683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614165.324917:0:22683:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787614165.324922:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787614165.331360:0:22634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787614165.331409:0:22634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787614165.331427:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.331439:0:22634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614165.331493:0:22634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787614165.331496:0:22634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5e7af67800 10000000:01000000:3.0:1787614165.331499:0:22634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5e7af67800 10000000:01000000:3.0:1787614165.331503:0:22634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787614165.331508:0:22634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5e7af67800 from 1 10000000:01000000:3.0:1787614165.331511:0:22634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787614165.331547:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.331556:0:22634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.331567:0:22634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.331592:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614165.331671:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.331708:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d43840a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787614165.332449:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692254976 00000100:00100000:0.0:1787614165.332458:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692254976 00000100:00100000:0.0:1787614165.332511:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787614165.332520:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22634:x1874448692254976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787614165.332534:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614165.332547:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e40030e00/0x9719586bc2ef0805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef07fe expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.332568:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e40030e00/0x9719586bc2ef0805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef07fe expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.332579:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e40030e00/0x9719586bc2ef0805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef07fe expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.332594:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e40030e00, rc 0) 00000100:00100000:0.0:1787614165.332653:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692254976:12345-0@lo:101:mount.lustre.0 Request processed in 133us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614165.332659:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787614165.334812:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692254976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614165.334984:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0805 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.334997:0:22634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0805 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614165.335077:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692255104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614165.335142:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.335194:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d417e59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614165.335225:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255104 00000100:00100000:2.0:1787614165.335231:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255104 00000100:00100000:2.0:1787614165.335284:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787614165.335292:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692255104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614165.335409:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692255104:12345-0@lo:501:mount.lustre.0 Request processed in 117us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614165.335416:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787614165.335452:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692255104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614165.335478:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692255232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614165.335517:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.335537:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d417e59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614165.337007:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255232 00000100:00100000:3.0:1787614165.337018:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255232 00000100:00100000:3.0:1787614165.337066:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787614165.337075:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692255232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614165.337230:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692255232:12345-0@lo:503:mount.lustre.0 Request processed in 156us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.337243:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787614165.338080:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692255232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787614165.339053:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22688:1874448692255360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787614165.339131:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614165.339200:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e452f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787614165.339960:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255360 00000100:00100000:2.0:1787614165.339967:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255360 00000100:00100000:2.0:1787614165.340026:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787614165.340041:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22688:x1874448692255360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787614165.340200:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22688:x1874448692255360:12345-0@lo:502:llog_process_th.0 Request processed in 166us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614165.340208:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787614165.340405:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22688:1874448692255360:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787614165.340465:0:22688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787614165.340479:0:22688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8b5e44413370) 00000020:00000080:0.0:1787614165.340496:0:22688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787614165.340586:0:22688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5e7af67800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787614165.340591:0:22688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5e7af67800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787614165.340593:0:22688:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5e7af67800 4 00010000:00080000:0.0:1787614165.340621:0:22688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e48465800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.155@tcp at head 00010000:00010000:0.0:1787614165.346362:0:22688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787614165.346550:0:22688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787614165.346587:0:22688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787614165.346599:0:22688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9719586bc2ef0813 00000100:00080000:0.0:1787614165.346608:0:22688:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787614165.346613:0:22688:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8b5e48465800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614165.348904:0:22688:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c4e00 x1874448692255488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614165.348932:0:22688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787614165.350064:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22688:1874448692255616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787614165.350149:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614165.350197:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255616 00000100:00100000:1.0:1787614165.350204:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255616 00000100:00100000:1.0:1787614165.350242:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787614165.350250:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22688:x1874448692255616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787614165.350352:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22688:x1874448692255616:12345-0@lo:502:llog_process_th.0 Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614165.350359:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787614165.350444:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e7b33c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787614165.350462:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22688:1874448692255616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787614165.350498:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22688:1874448692255744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787614165.350527:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614165.350551:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255744 00000100:00100000:1.0:1787614165.350554:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255744 00000100:00100000:1.0:1787614165.350572:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787614165.350577:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22688:x1874448692255744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787614165.350644:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22688:x1874448692255744:12345-0@lo:502:llog_process_th.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614165.350650:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787614165.350679:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e7b33c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787614165.350690:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22688:1874448692255744:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787614165.350707:0:22688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1787614165.352808:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874448692255488:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787614165.353952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614165.354042:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255488 00000100:00100000:2.0:1787614165.354123:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255488 00000100:00100000:2.0:1787614165.354176:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787614165.354183:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692255488:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787614165.354238:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692255488:12345-0@lo:38:llog_process_th.0 Request processed in 53us (288us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787614165.354254:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787614165.354291:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787614165.354298:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48465800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787614165.354302:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787614165.354306:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874448692255488:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787614165.355897:0:22634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787614165.355923:0:22634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787614165.355939:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0805 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614165.355951:0:22634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1e00/0x9719586bc2ef07fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0805 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787614165.356005:0:22634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787614165.356007:0:22634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787614165.356008:0:22634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614165.356010:0:22634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614165.356011:0:22634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614165.356012:0:22634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614165.356013:0:22634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787614165.356015:0:22634:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787614165.356017:0:22634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614165.356018:0:22634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787614165.356021:0:22634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787614165.356024:0:22634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787614165.356025:0:22634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787614165.356026:0:22634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614165.356028:0:22634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614165.356029:0:22634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614165.356030:0:22634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614165.356031:0:22634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787614165.356032:0:22634:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787614165.356033:0:22634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614165.356039:0:22634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787614165.356062:0:22634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787614165.356080:0:22634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692255872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787614165.356150:0:22634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614165.357020:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692255872 00000100:00100000:1.0:1787614165.357029:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692255872 00000100:00100000:1.0:1787614165.357072:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787614165.357083:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692255872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787614165.357123:0:22649:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787614165.357136:0:22649:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787614165.359736:0:22634:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d417e5d80 going to sleep for 11 seconds 20000000:01000000:2.0:1787614165.363786:0:22649:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787614165.363805:0:22649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787614165.364132:0:22671:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787614165.364143:0:22671:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787614165.364181:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.364199:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.364208:0:22671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.364244:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.364256:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 12 pid: 22649 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614165.364269:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692256000:0@lo:104: 00000100:00100000:0.0:1787614165.364323:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614165.364354:0:22671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e452f9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787614165.364385:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256000 00000100:00100000:0.0:1787614165.364391:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256000 00000100:00100000:0.0:1787614165.364426:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787614165.364433:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692256000:12345-0@lo:104: 00010000:00010000:0.0:1787614165.364444:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614165.364487:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787614165.364493:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692256000:12345-0@lo:104: Request processed in 61us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614165.364500:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787614165.364637:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22634:x1874448692255872:12345-0@lo:253:mount.lustre.0 Request processed in 7546us (8476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614165.364646:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787614165.364687:0:22634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22634:1874448692255872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787614165.364697:0:22634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787614165.364700:0:22634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787614165.364702:0:22634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787614165.364703:0:22634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614165.364704:0:22634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614165.364706:0:22634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614165.364707:0:22634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614165.364709:0:22634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787614165.364710:0:22634:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787614165.364721:0:22634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614165.364722:0:22634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787614165.364734:0:22634:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787614165.365836:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614165.365845:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.365855:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f0e00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:3.0:1787614165.365859:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.365867:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787614165.365874:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614165.365879:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787614165.365915:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.365922:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787614165.365947:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.365954:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef07e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef07e9 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.365972:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614165.365974:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614165.365976:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614165.366012:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787614165.366034:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692256128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787614165.366078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614165.366143:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256128 00000100:00100000:3.0:1787614165.366149:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256128 00010000:00010000:3.0:1787614165.366206:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 12 pid: 22649 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.366227:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787614165.366236:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:3635:x1874448692256128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787614165.366246:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614165.366251:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 12 pid: 22649 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366262:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 12 pid: 22649 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366277:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366283:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787614165.366297:0:22640:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002155190s 00010000:00010000:3.0:1787614165.366302:0:22640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366309:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366316:0:22640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366333:0:22640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366339:0:22640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e40031200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614165.366342:0:22640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366349:0:22640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366357:0:22640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.366368:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614165.366398:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:3635:x1874448692256128:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614165.366405:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787614165.366438:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692256128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787614165.367942:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0200/0x9719586bc2ef07e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef07e2 expref: 11 pid: 22649 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614165.367958:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692256000:0@lo:104: 00010000:00010000:3.0:1787614165.367983:0:22671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.367992:0:22671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.368015:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614165.368022:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e40031200/0x9719586bc2ef081a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787614165.402179:0:22634:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1787614165.402440:0:22634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787614165.402494:0:22695:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1787614165.402498:0:22695:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1787614165.402807:0:22696:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1787614165.403418:0:22696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787614165.404985:0:22634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1787614165.405698:0:22697:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8b5e763c7800 x1874448692256256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000040:01000000:1.0:1787614165.406442:0:22634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787614165.406484:0:22634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787614165.407142:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00000040:00080000:3.0:1787614165.408976:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787614165.409084:0:22696:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1787614165.409337:0:22634:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787614165.409351:0:22634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787614165.409432:0:22634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614165.410418:0:22634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787614165.410946:0:22634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787614165.410975:0:22634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787614165.412932:0:22634:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1787614165.413612:0:22634:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1787614165.416290:0:22634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787614165.418274:0:22634:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787614165.418308:0:22634:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0298148b988 00100000:10000000:1.0:1787614165.418325:0:22634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787614165.419496:0:22634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787614165.419512:0:22634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787614165.419528:0:22634:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787614165.419542:0:22634:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787614165.430405:0:22634:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787614165.430595:0:22634:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787614165.873349:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787614166.386400:0:22691:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787614166.386412:0:22691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787614166.387743:0:22691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787614166.387757:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787614166.449457:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787614166.908034:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787614166.909868:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787614166.909875:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e7af67800 from 11 10000000:01000000:2.0:1787614166.909880:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787614166.910242:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614166.910266:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614166.910279:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614166.910304:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692256384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787614166.910372:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614166.910422:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6de1c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787614166.910777:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256384 00000100:00100000:1.0:1787614166.910786:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256384 00000100:00100000:1.0:1787614166.910840:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787614166.910848:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+11:22652:x1874448692256384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787614166.910861:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614166.910874:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0821 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614166.910895:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614166.910978:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614166.910987:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41669800, rc 0) 00000100:00100000:1.0:1787614166.911084:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22652:x1874448692256384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614166.911091:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787614166.914389:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692256384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787614166.914416:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614166.914428:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614166.914499:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692256512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787614166.914563:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614166.914597:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614166.914779:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256512 00000100:00100000:2.0:1787614166.914786:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256512 00000100:00100000:2.0:1787614166.914842:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787614166.914852:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22652:x1874448692256512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787614166.914871:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787614166.914886:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787614166.914889:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787614166.914986:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:22652:x1874448692256512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614166.914994:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787614166.919485:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692256512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787614166.919562:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787614166.919574:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614166.919585:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787614167.409495:0:22691:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787614167.409504:0:22691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787614167.409633:0:22691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787614167.409677:0:22691:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787614167.410027:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787614167.474148:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614167.922970:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614168.497245:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614168.945309:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614169.521444:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787614169.969877:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787614170.028696:0:22940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787614170.418403:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787614170.418410:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787614170.418413:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614170.418433:0:13196:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 662 00000100:00080000:2.0:1787614170.418439:0:13196:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787614170.418446:0:13196:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8b5e48346000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614170.418468:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48472680 x1874448692256768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787614170.418485:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614170.418488:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614170.418491:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614170.418494:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614170.418497:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787614170.418500:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787614170.418502:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48465800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614170.418507:0:13196:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8b5e48465800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614170.418518:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48473b80 x1874448692256896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787614170.418544:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692256768:0@lo:38:kworker.0 00000100:00100000:2.0:1787614170.418607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614170.418661:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874448692256896:0@lo:38:kworker.0 00000100:00100000:2.0:1787614170.418686:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614170.418742:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256768 00000100:00100000:2.0:1787614170.418750:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256768 00000100:00100000:2.0:1787614170.418777:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787614170.418784:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1874448692256768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787614170.418799:0:22661:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787614170.418846:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1874448692256768:12345-0@lo:38:kworker.0 Request processed in 61us (238us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787614170.418853:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787614170.418893:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787614170.418898:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787614170.418901:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692256768:0@lo:38:kworker.0 00000100:00100000:1.0:1787614170.419220:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692256640:0@lo:400:kworker.0 00000100:00100000:1.0:1787614170.419257:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614170.419478:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256640 00000100:00100000:2.0:1787614170.419483:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256640 00000100:00100000:2.0:1787614170.419528:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787614170.419535:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:3637:x1874448692256640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614170.419581:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:3637:x1874448692256640:12345-0@lo:400:kworker.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614170.419588:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787614170.419626:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692256640:0@lo:400:kworker.0 00000100:00100000:2.0:1787614170.420446:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256896 00000100:00100000:2.0:1787614170.420453:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256896 00000100:00100000:2.0:1787614170.420485:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787614170.420492:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1874448692256896:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787614170.420514:0:22657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1787614170.420554:0:22657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9719586bc2ef082f 00000004:00100000:2.0:1787614170.420570:0:22657:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787614170.420697:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8b5e4674c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614170.420862:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874448692256896:12345-0@lo:38:kworker.0 Request processed in 369us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614170.420869:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787614170.425809:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5e48473b80 x1874448692256896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787614180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787614170.425833:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787614170.425857:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787614170.425863:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787614170.425866:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48465800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787614170.425873:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874448692256896:0@lo:38:kworker.0 00000100:00100000:2.0:1787614170.545394:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00000020:00000004:1.0:1787614170.899785:0:22992:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787614170.900095:0:22992:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787614170.994581:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614171.580603:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00000020:00000004:3.0:1787614171.988300:0:23042:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787614171.988523:0:23042:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787614172.021223:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614172.593812:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614173.041340:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614173.620927:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614174.069305:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614174.649906:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614175.095090:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614175.548828:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614165/real 1787614165] req@ffff8b5e777f4e00 x1874448692253824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614175 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614175.548858:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e777f4e00 x1874448692253824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614175 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614175.548868:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614165/real 1787614165] req@ffff8b5e48470000 x1874448692253696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614175 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614175.548879:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e48470000 x1874448692253696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614175 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787614175.548895:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614175.548904:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787614175.548916:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692253824:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787614175.548921:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614175.548926:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787614175.548929:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692253696:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787614175.549330:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787614175.549334:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787614175.549337:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614175.549342:0:13196:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 667 00000100:00080000:0.0:1787614175.549346:0:13196:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787614175.549352:0:13196:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8b5e48346000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614175.549371:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c5f80 x1874448692257152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614175.549386:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614175.549389:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787614175.549391:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614175.549394:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 662 00000100:00080000:0.0:1787614175.549396:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787614175.549398:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b5e4608e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614175.549410:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c6300 x1874448692257280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614175.549418:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614175.549426:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787614175.549428:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614175.549431:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 662 00000100:00080000:0.0:1787614175.549434:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787614175.549437:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b5e67931800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614175.549617:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c5500 x1874448692257408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787614175.549650:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787614175.549661:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692257024:0@lo:400:kworker.0 00000100:00100000:0.0:1787614175.549719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614175.549766:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692257152:0@lo:38:kworker.0 00000100:00100000:0.0:1787614175.549793:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614175.549812:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692257280:0@lo:8:kworker.0 00000400:00000100:0.0:1787614175.549831:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692257280 offset 0 length 520: 4 00000100:00100000:0.0:1787614175.549843:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692257408:0@lo:8:kworker.0 00000400:00000100:0.0:1787614175.549858:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692257408 offset 0 length 520: 4 00000100:00100000:0.0:1787614175.549876:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787614175.549882:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874448692257536:0@lo:400:kworker.0 00000100:00100000:0.0:1787614175.549908:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614175.549936:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692257024 00000100:00100000:0.0:1787614175.549942:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692257024 00000100:00100000:0.0:1787614175.549982:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787614175.549990:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:3637:x1874448692257024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614175.550033:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:3637:x1874448692257024:12345-0@lo:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614175.550061:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787614175.550111:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692257152 00000100:00100000:0.0:1787614175.550116:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692257152 00000100:00100000:0.0:1787614175.550138:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787614175.550143:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1874448692257152:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787614175.550181:0:22661:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787614175.550211:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1874448692257152:12345-0@lo:38:kworker.0 Request processed in 68us (416us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787614175.550216:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787614175.550241:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692257536 00000100:00100000:0.0:1787614175.550244:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692257536 00000100:00100000:0.0:1787614175.550263:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787614175.550268:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874448692257536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614175.550297:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874448692257536:12345-0@lo:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614175.550302:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787614175.550336:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5e763c4e00 x1874448692257536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614175.550347:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874448692257536:0@lo:400:kworker.0 00000100:00080000:0.0:1787614175.550368:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787614175.550372:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787614175.550375:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692257152:0@lo:38:kworker.0 00000100:00100000:0.0:1787614175.550394:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692257024:0@lo:400:kworker.0 00000100:00100000:1.0:1787614175.670595:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614176.121378:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614176.697246:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614177.137365:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787614177.651518:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787614177.713483:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614178.162437:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614178.737282:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787614179.188455:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787614179.448839:0:23389:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787614179.448843:0:23389:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787614179.448845:0:23389:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787614179.448951:0:23389:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b5e51a93800 00000020:01000004:2.0:1787614179.448965:0:23389:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787614179.448977:0:23389:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787614179.448992:0:23389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8b5d432e19b8) 00000020:00000080:2.0:1787614179.449007:0:23389:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787614179.554066:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1787614179.557890:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787614179.571010:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787614179.573141:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787614179.575983:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787614179.577126:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787614179.577757:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787614179.578398:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787614179.579184:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787614179.581607:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787614179.582325:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787614179.583648:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787614179.584229:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787614179.584525:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787614179.600023:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787614179.602053:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787614179.608635:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.621927:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.623647:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.625072:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.625694:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.626125:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.626597:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.627175:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.627433:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.627757:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.628331:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.628687:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.629442:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.632018:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.632764:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.633254:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.633617:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.633945:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.634836:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.635191:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.635618:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.636456:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.639407:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.639995:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.640299:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.640991:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787614179.641306:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.641605:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.641997:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787614179.642248:0:23389:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:2.0:1787614179.643147:0:23389:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787614179.643409:0:23389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787614179.643422:0:23389:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787614179.643433:0:23389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9719586bc2ef083d 00000020:01000004:2.0:1787614179.643441:0:23389:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787614179.643460:0:23389:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787614179.643463:0:23389:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787614179.643468:0:23389:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787614179.643495:0:23389:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787614179.643499:0:23389:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787614179.649271:0:23389:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787614179.649394:0:23389:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.155@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787614179.649399:0:23389:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787614179.649401:0:23389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787614179.649402:0:23389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614179.649404:0:23389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614179.649405:0:23389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614179.649406:0:23389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614179.649408:0:23389:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787614179.649410:0:23389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614179.649411:0:23389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787614179.649415:0:23389:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787614179.649418:0:23389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787614179.649419:0:23389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787614179.649420:0:23389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614179.649422:0:23389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614179.649423:0:23389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614179.649424:0:23389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614179.649424:0:23389:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787614179.649425:0:23389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614179.649426:0:23389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787614179.649453:0:23389:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787614179.649473:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692257664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787614179.649539:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.649646:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e59697600 going to sleep for 11 seconds 00000100:00100000:1.0:1787614179.649855:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692257664 00000100:00100000:1.0:1787614179.649868:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692257664 00000100:00100000:1.0:1787614179.649924:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787614179.649936:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:23389:x1874448692257664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787614179.649980:0:22649:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787614179.649983:0:22649:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787614179.649990:0:22649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787614179.654008:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:23389:x1874448692257664:12345-0@lo:253:mount.lustre.0 Request processed in 4064us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.654022:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787614179.654197:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692257664:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787614179.654215:0:23389:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787614179.654218:0:23389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787614179.654220:0:23389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787614179.654221:0:23389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787614179.654222:0:23389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787614179.654223:0:23389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787614179.654224:0:23389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787614179.654226:0:23389:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787614179.654227:0:23389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787614179.654228:0:23389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787614179.654288:0:23389:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5e51a93800 from lustre-MDT0001 10000000:01000000:0.0:1787614179.654321:0:23389:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787614179.654324:0:23389:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787614179.654330:0:23389:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b5e7afb19b8 local copy 00010000:00010000:0.0:1787614179.654341:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614179.654440:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692257792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787614179.654479:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614179.654516:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e50bf1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.654648:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692257792 00000100:00100000:2.0:1787614179.654655:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692257792 00000100:00100000:2.0:1787614179.654715:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787614179.654724:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:23389:x1874448692257792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614179.654819:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:23389:x1874448692257792:12345-0@lo:501:mount.lustre.0 Request processed in 97us (340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787614179.654827:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787614179.654865:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692257792:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787614179.654879:0:23389:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787614179.654900:0:23389:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787614179.654906:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.654915:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614179.654942:0:23389:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5e51a93800 10000000:01000000:3.0:1787614179.654946:0:23389:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787614179.654951:0:23389:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8b5e7afb19b8 10000000:01000000:3.0:1787614179.654953:0:23389:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787614179.654957:0:23389:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b5e7afb19b8 from 1 10000000:01000000:3.0:1787614179.654960:0:23389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787614179.654984:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.654991:0:23389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.654999:0:23389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.655011:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692257920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614179.655054:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.655089:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035840 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.655133:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692257920 00000100:00100000:2.0:1787614179.655139:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692257920 00000100:00100000:0.0:1787614179.655208:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787614179.655216:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+12:23389:x1874448692257920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787614179.655225:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614179.655237:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e40030c00/0x9719586bc2ef084b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0844 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614179.655256:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e40030c00/0x9719586bc2ef084b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0844 expref: 13 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614179.655274:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e40030c00/0x9719586bc2ef084b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0844 expref: 13 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614179.655282:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e40030c00, rc 0) 00000100:00100000:0.0:1787614179.655327:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+13:23389:x1874448692257920:12345-0@lo:101:mount.lustre.0 Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.655392:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692257920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614179.655406:0:23389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef084b expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.655422:0:23389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef084b expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614179.655437:0:23389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787614179.655454:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef084b expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.655461:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0e00/0x9719586bc2ef0844 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef084b expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614179.655468:0:23389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b5e51a93800 10000000:01000000:3.0:1787614179.655472:0:23389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787614179.655475:0:23389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8b5e51a93800 from 1 10000000:01000000:3.0:1787614179.655477:0:23389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787614179.655491:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.655497:0:23389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.655503:0:23389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.655515:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614179.655540:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.655569:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035840 going to sleep for 11 seconds 00000100:00100000:1.0:1787614179.657977:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258048 00000100:00100000:1.0:1787614179.657999:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258048 00000100:00100000:0.0:1787614179.658074:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787614179.666600:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787614179.666622:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+13:23389:x1874448692258048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614179.666638:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614179.666656:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41668e00/0x9719586bc2ef0859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0852 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.666685:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41668e00/0x9719586bc2ef0859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0852 expref: 14 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.666696:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41668e00/0x9719586bc2ef0859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0852 expref: 14 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.666714:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41668e00, rc 0) 00000100:00100000:1.0:1787614179.666919:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+14:23389:x1874448692258048:12345-0@lo:101:mount.lustre.0 Request processed in 307us (11376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.666926:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787614179.667053:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614179.667072:0:23389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0859 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.667093:0:23389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0859 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614179.667110:0:23389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787614179.667127:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0859 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.667134:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1800/0x9719586bc2ef0852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0859 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614179.667141:0:23389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787614179.667145:0:23389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787614179.667151:0:23389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b5e51a93800 10000000:01000000:3.0:1787614179.667180:0:23389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787614179.667185:0:23389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787614179.667187:0:23389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787614179.667210:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.667217:0:23389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.667225:0:23389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.667242:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614179.667276:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.667311:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035840 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.667401:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258176 00000100:00100000:2.0:1787614179.667410:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258176 00000100:00100000:2.0:1787614179.667441:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787614179.667448:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+14:23389:x1874448692258176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614179.667455:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614179.667467:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7af98c00/0x9719586bc2ef0867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0860 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614179.667479:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7af98c00/0x9719586bc2ef0867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0860 expref: 15 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614179.667487:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7af98c00/0x9719586bc2ef0867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0860 expref: 15 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614179.667493:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7af98c00, rc 0) 00000100:00100000:2.0:1787614179.667523:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258176:12345-0@lo:101:mount.lustre.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614179.667529:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787614179.667617:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614179.667628:0:23389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0867 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.667635:0:23389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0867 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787614179.672579:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1787614179.673481:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614179.678631:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787614179.678691:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1787614179.678709:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1787614179.678734:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1787614179.679492:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1787614179.679517:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1787614179.679531:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1787614179.679543:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1787614179.679570:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1787614179.679587:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1787614179.679601:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1787614179.679628:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1787614179.679642:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1787614179.679655:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1787614179.679667:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1787614179.679680:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1787614179.679695:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1787614179.679708:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1787614179.679722:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1787614179.679737:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1787614179.681560:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1787614179.681588:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1787614179.681602:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1787614179.681617:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1787614179.681631:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1787614179.681645:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1787614179.681657:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1787614179.681671:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1787614179.681684:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1787614179.681700:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1787614179.682251:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1787614179.682269:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1787614179.682282:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1787614179.682295:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1787614179.682308:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1787614179.682320:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1787614179.682350:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1787614179.682363:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1787614179.682375:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1787614179.682387:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1787614179.682402:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1787614179.682415:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1787614179.682427:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1787614179.682439:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1787614179.682468:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1787614179.682474:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1787614179.682581:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614179.682645:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.682847:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787614179.682962:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258304 00000100:00100000:0.0:1787614179.682969:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258304 00000100:00100000:0.0:1787614179.683085:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787614179.683095:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787614179.683272:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258304:12345-0@lo:501:mount.lustre.0 Request processed in 177us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.683279:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787614179.683398:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614179.683433:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614179.683478:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.684151:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.684304:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258432 00000100:00100000:2.0:1787614179.684311:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258432 00000100:00100000:2.0:1787614179.684348:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787614179.684357:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614179.685488:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258432:12345-0@lo:503:mount.lustre.0 Request processed in 1127us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614179.685500:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787614179.685624:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787614179.686067:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787614179.686143:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614179.686248:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.686275:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787614179.686402:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258560 00000100:00100000:0.0:1787614179.686408:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258560 00000100:00100000:0.0:1787614179.686456:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787614179.686465:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614179.687503:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258560:12345-0@lo:502:mount.lustre.0 Request processed in 1035us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.687513:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787614179.687804:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787614179.688067:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787614179.688113:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787614179.688130:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787614179.688142:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787614179.688255:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787614179.688270:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787614179.688283:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787614179.688447:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787614179.688467:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787614179.688482:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787614179.688495:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787614179.688508:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787614179.688522:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787614179.688535:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787614179.688547:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787614179.688560:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787614179.688573:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787614179.688602:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787614179.688618:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787614179.688631:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787614179.688644:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787614179.688664:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787614179.688679:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787614179.688693:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787614179.688969:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787614179.688989:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787614179.689004:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787614179.689015:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787614179.689038:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787614179.689056:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787614179.689066:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787614179.689077:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787614179.689088:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787614179.689115:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787614179.689130:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787614179.689144:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787614179.689181:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787614179.689207:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787614179.689221:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787614179.689234:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787614179.689245:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787614179.689258:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787614179.689270:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787614179.689282:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787614179.689324:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614179.689393:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.689439:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.689453:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258688 00000100:00100000:2.0:1787614179.689461:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258688 00000100:00100000:2.0:1787614179.689523:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787614179.689534:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614179.689675:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692258688:12345-0@lo:502:mount.lustre.0 Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614179.689683:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787614179.689884:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692258688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787614179.689931:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787614179.689940:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787614179.691982:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614179.691995:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.691997:0:23393:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787614179.692002:0:23393:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787614179.692005:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787614179.692020:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8b5d420899b8) 00000020:00000080:1.0:1787614179.692050:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787614179.692057:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787614179.692147:0:23393:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787614179.692199:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9719586bc2ef0875 00000020:00000080:1.0:1787614179.692412:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787614179.692418:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614179.692422:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.692423:0:23393:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787614179.692425:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614179.692429:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.692430:0:23393:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787614179.692433:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787614179.692446:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8b5d4208cd28) 00000020:00000080:1.0:1787614179.692457:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787614179.692461:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787614179.692463:0:23393:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787614179.692466:0:23393:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787614179.692472:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787614179.692518:0:23393:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5e51a93800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787614179.692531:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8b5e7554cd28) 00000020:00000080:1.0:1787614179.692538:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787614179.692604:0:23393:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787614179.692610:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef088a 00000020:00000080:1.0:1787614179.692694:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787614179.692701:0:23393:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787614179.692706:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9719586bc2ef0891 00080000:01000000:1.0:1787614179.692711:0:23393:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787614179.692714:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9719586bc2ef0898 00000100:00100000:1.0:1787614179.764333:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787614179.803816:0:23393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787614179.810897:0:23393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1787614179.814989:0:23393:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787614179.818661:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787614179.818674:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614179.818681:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.818683:0:23393:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787614179.818688:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614179.818694:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.818695:0:23393:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787614179.818698:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787614179.818704:0:23393:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:00000080:3.0:1787614179.818750:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787614179.818766:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8b5e67b44d28) 00000020:00000080:3.0:1787614179.818787:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787614179.818793:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787614179.818885:0:23393:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787614179.818892:0:23393:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787614179.818900:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9719586bc2ef08a6 00010000:00080000:3.0:1787614179.818932:0:23393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5d432ab800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.155@tcp at head 00010000:00010000:3.0:1787614179.820545:0:23393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787614179.826054:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787614179.826070:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787614179.826113:0:23393:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787614179.826136:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef08ad 00000100:00080000:0.0:1787614179.826145:0:23393:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787614179.826193:0:23393:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b5d432ab800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614179.826294:0:23393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c5f80 x1874448692258816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787614179.826330:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692258816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787614179.826394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614179.826525:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258816 00000100:00100000:2.0:1787614179.826532:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258816 00000100:00100000:2.0:1787614179.826565:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787614179.826573:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1874448692258816:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787614179.826595:0:22661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:2.0:1787614179.826623:0:22661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef08b4 00000004:00100000:2.0:1787614179.826636:0:22661:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787614179.826641:0:22661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1787614179.826764:0:23393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787614179.826819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787614179.826823:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787614179.826825:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614179.826830:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:0.0:1787614179.826834:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787614179.826838:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8b5e48346000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614179.826863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c4000 x1874448692259072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614179.826876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614179.826879:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614179.826881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614179.826884:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787614179.826910:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692258944:0@lo:400:kworker.0 00000100:00100000:0.0:1787614179.826940:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614179.826962:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692259200:0@lo:400:kworker.0 00000100:00100000:0.0:1787614179.826983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614179.827005:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692258944 00000100:00100000:0.0:1787614179.827013:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692258944 00000100:00100000:0.0:1787614179.827056:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787614179.827062:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:3636:x1874448692258944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614179.827099:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:3636:x1874448692258944:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.827105:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787614179.827128:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692259200 00000100:00100000:0.0:1787614179.827131:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692259200 00000100:00100000:0.0:1787614179.827150:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787614179.827176:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692259200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614179.827205:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692259200:12345-0@lo:400:kworker.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.827211:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787614179.828130:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692258944:0@lo:400:kworker.0 00000100:00100000:2.0:1787614179.830449:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692259072:0@lo:38:kworker.0 00000100:00100000:2.0:1787614179.832670:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614179.832743:0:22660:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787614179.832752:0:22660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:01000000:2.0:1787614179.832846:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614179.832852:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614179.832854:0:23393:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787614179.832858:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787614179.832872:0:23393:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787614179.832874:0:23393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787614179.832875:0:23393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787614179.832877:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787614179.832880:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614179.832881:0:23393:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787614179.832884:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614179.832889:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614179.832890:0:23393:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787614179.832894:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787614179.832962:0:23393:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787614179.832984:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614179.832988:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614179.832989:0:23393:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787614179.832992:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787614179.832993:0:23393:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787614179.832995:0:23393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787614179.832996:0:23393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787614179.832998:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787614179.833000:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614179.833001:0:23393:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787614179.833003:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787614179.833007:0:23393:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787614179.833010:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614179.833011:0:23393:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787614179.833014:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787614179.833018:0:23393:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:2.0:1787614179.833052:0:23393:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787614179.833055:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787614179.833070:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8b5d432e0000) 00000020:00000080:2.0:1787614179.833088:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787614179.833094:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787614179.833511:0:23393:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787614179.833517:0:23393:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787614179.833529:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9719586bc2ef08c2 00010000:00080000:2.0:1787614179.833579:0:23393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e454fd800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1787614179.833801:0:23393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1787614179.834212:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692259072 00000100:00100000:2.0:1787614179.834221:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692259072 00010000:00080000:0.0:1787614179.834274:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5e763c6d80 x1874448692259200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614179.834324:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787614179.834332:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1874448692259072:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787614179.834349:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692259200:0@lo:400:kworker.0 00000100:00100000:2.0:1787614179.835524:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1874448692259072:12345-0@lo:38:kworker.0 Request processed in 1186us (2851us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787614179.835535:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787614179.835593:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787614179.835600:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787614179.835606:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787614179.835609:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692259072:0@lo:38:kworker.0 00000040:01000000:2.0:1787614179.837724:0:23393:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1787614179.838003:0:22661:0:(import.c:65:import_set_state_nolock()) ffff8b5d432ad800 : changing import state from RECOVER to FULL 00000040:01000000:2.0:1787614179.838009:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1787614179.838107:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1874448692258816:12345-0@lo:38:llog_process_th.0 Request processed in 11532us (11710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.838126:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787614179.838195:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787614179.838204:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787614179.838212:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787614179.838216:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787614179.838219:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d432ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787614179.838231:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692258816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787614179.838658:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692259328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614179.838700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614179.838818:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692259328 00000100:00100000:0.0:1787614179.838825:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692259328 00000100:00100000:0.0:1787614179.838863:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787614179.838871:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874448692259328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787614179.838898:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787614179.838935:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874448692259328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.838941:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787614179.839385:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692259328:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787614179.840598:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787614179.841992:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787614179.842446:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787614179.843136:0:23399:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787614179.843141:0:23399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787614179.844294:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787614179.844314:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787614179.844359:0:23393:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787614179.844386:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef08c9 00000100:00080000:0.0:1787614179.844398:0:23393:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787614179.844403:0:23393:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8b5e454fd800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1787614179.844517:0:23393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e7614b100 x1874448692259456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787614179.844545:0:23393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787614179.844622:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614179.844627:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.844628:0:23393:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787614179.844632:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787614179.844635:0:23393:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787614179.844636:0:23393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787614179.844638:0:23393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787614179.844639:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787614179.844642:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.844643:0:23393:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787614179.844646:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787614179.844659:0:23393:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787614179.844663:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.844664:0:23393:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787614179.844668:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787614179.844673:0:23393:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.155@tcp to nid 0x20000c0a8ce9b (192.168.206.155@tcp) 00000020:01000000:1.0:1787614179.844702:0:23393:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787614179.844705:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787614179.844717:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8b5e75548000) 00000020:00000080:1.0:1787614179.844729:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00100000:3.0:1787614179.844734:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692259456:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1787614179.844734:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000400:00000100:3.0:1787614179.844781:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692259456 offset 0 length 520: 4 00000100:00080000:0.0:1787614179.844892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614179.844898:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614179.844900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614179.844902:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:1.0:1787614179.844987:0:23393:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787614179.844995:0:23393:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787614179.845001:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9719586bc2ef08d7 00010000:00080000:1.0:1787614179.845038:0:23393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e48565800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1787614179.845688:0:23393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787614179.845831:0:23393:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787614179.845915:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787614179.848806:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614179.854619:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787614179.854794:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787614179.855254:0:23401:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787614179.855259:0:23401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787614179.855981:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787614179.855994:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787614179.856041:0:23393:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787614179.856062:0:23393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef08de 00000100:00080000:1.0:1787614179.856072:0:23393:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787614179.856077:0:23393:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8b5e48565800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1787614179.856122:0:23393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e76148380 x1874448692259584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787614179.856154:0:23393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787614179.856322:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614179.856327:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614179.856329:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614179.856332:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1787614179.856979:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614179.856993:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.856995:0:23393:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787614179.856999:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614179.857003:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.857004:0:23393:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787614179.857007:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787614179.857009:0:23393:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787614179.857010:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614179.857013:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.857014:0:23393:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787614179.857016:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614179.857018:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.857019:0:23393:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787614179.857023:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787614179.857063:0:23393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614179.857067:0:23393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614179.857068:0:23393:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787614179.857071:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1787614179.857189:0:23389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787614179.857221:0:23389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787614179.857251:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0867 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614179.857263:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0c00/0x9719586bc2ef0860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0867 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614179.857271:0:23389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e51a93800 from 1 10000000:01000000:0.0:1787614179.857274:0:23389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1787614179.857393:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692259584:0@lo:8:llog_process_th.0 00010000:00010000:0.0:1787614179.857421:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614179.857438:0:23389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614179.857448:0:23389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:3.0:1787614179.857455:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692259584 offset 0 length 520: 4 00000100:00100000:0.0:1787614179.857464:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692259712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787614179.862202:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.862411:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4322b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.862495:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692259712 00000100:00100000:3.0:1787614179.862505:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692259712 00000100:00100000:3.0:1787614179.862660:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787614179.862671:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+15:23389:x1874448692259712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614179.862687:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614179.862705:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef08e5 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.862732:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 16 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.862761:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 16 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.862770:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f1a00, rc 0) 00000100:00100000:3.0:1787614179.862829:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:23389:x1874448692259712:12345-0@lo:101:mount.lustre.0 Request processed in 160us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.862836:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787614179.862908:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692259712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614179.862925:0:23389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.862934:0:23389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614179.863726:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692259840:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787614179.863778:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.864038:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787614179.864108:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692259840 00000100:00100000:0.0:1787614179.864115:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692259840 00000100:00100000:0.0:1787614179.864147:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787614179.864154:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:23389:x1874448692259840:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787614179.864197:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787614179.864215:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787614179.864219:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787614179.864314:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:23389:x1874448692259840:12345-0@lo:256:mount.lustre.0 Request processed in 160us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.864321:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787614179.864533:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692259840:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787614179.865844:0:23389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787614179.865871:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.865884:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614179.865894:0:23389:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5e51a93800 from 1 10000000:01000000:1.0:1787614179.865896:0:23389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787614179.865933:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.865940:0:23389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.865951:0:23389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614179.865971:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692259968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787614179.866020:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.866077:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692259968 00000100:00100000:1.0:1787614179.866083:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692259968 00000100:00100000:1.0:1787614179.866116:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787614179.866124:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:23389:x1874448692259968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614179.866134:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614179.866143:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef08f3 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.866183:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.866202:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.866211:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41669a00, rc 0) 00000100:00100000:1.0:1787614179.866368:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692259968:12345-0@lo:101:mount.lustre.0 Request processed in 244us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.866375:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787614179.866418:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787614179.866436:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692259968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614179.866451:0:23389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.866459:0:23389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787614179.867812:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1787614179.868083:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614179.868910:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787614179.868944:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1787614179.868959:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1787614179.868973:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1787614179.868985:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1787614179.869013:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1787614179.869042:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1787614179.869058:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1787614179.869071:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787614179.869084:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1787614179.869098:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1787614179.869129:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1787614179.869134:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1787614179.869705:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614179.869772:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.869871:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.869956:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260096 00000100:00100000:2.0:1787614179.869963:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260096 00000100:00100000:0.0:1787614179.870084:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787614179.870096:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787614179.870369:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260096:12345-0@lo:501:mount.lustre.0 Request processed in 274us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.870377:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787614179.870476:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614179.870510:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614179.870565:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.870638:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787614179.872498:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260224 00000100:00100000:1.0:1787614179.872515:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260224 00000100:00100000:1.0:1787614179.872567:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787614179.872577:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614179.872841:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260224:12345-0@lo:503:mount.lustre.0 Request processed in 264us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.872849:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787614179.873010:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260224:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787614179.873471:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787614179.873789:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614179.873840:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614179.873876:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4855ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787614179.874109:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260352 00000100:00100000:0.0:1787614179.874115:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260352 00000100:00100000:0.0:1787614179.874174:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787614179.874184:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614179.874296:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260352:12345-0@lo:502:mount.lustre.0 Request processed in 113us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.874304:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787614179.874390:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614179.874632:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787614179.874663:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1787614179.874683:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1787614179.874698:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1787614179.874712:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1787614179.874726:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1787614179.874739:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1787614179.874752:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1787614179.874764:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787614179.874776:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1787614179.874790:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1787614179.874817:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614179.874856:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.874902:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035600 going to sleep for 11 seconds 00000100:00100000:0.0:1787614179.875018:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260480 00000100:00100000:0.0:1787614179.875023:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260480 00000100:00100000:0.0:1787614179.875062:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787614179.875069:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614179.875153:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260480:12345-0@lo:502:mount.lustre.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.875177:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787614179.875328:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614179.875371:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1787614179.875381:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787614179.876333:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614179.876344:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876351:0:23403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787614179.876358:0:23403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5e51a93800 00000020:00000080:3.0:1787614179.876360:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787614179.876369:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614179.876372:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876373:0:23403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787614179.876375:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614179.876378:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876379:0:23403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787614179.876383:0:23403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5e51a93800 00000020:00000080:3.0:1787614179.876385:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787614179.876433:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614179.876437:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876439:0:23403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787614179.876441:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614179.876443:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876444:0:23403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787614179.876447:0:23403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5e51a93800 00000020:00000080:3.0:1787614179.876449:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787614179.876467:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614179.876470:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876472:0:23403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787614179.876474:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614179.876476:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876477:0:23403:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787614179.876481:0:23403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5e51a93800 00000020:00000080:3.0:1787614179.876483:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787614179.876505:0:23403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614179.876509:0:23403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614179.876510:0:23403:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787614179.876512:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787614179.878767:0:23389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787614179.878809:0:23389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787614179.878835:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.878860:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614179.878915:0:23389:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787614179.878919:0:23389:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5e51a93800 10000000:01000000:3.0:1787614179.878922:0:23389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5e51a93800 10000000:01000000:3.0:1787614179.878926:0:23389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787614179.878932:0:23389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5e51a93800 from 1 10000000:01000000:3.0:1787614179.878934:0:23389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787614179.878969:0:23389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.878977:0:23389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.878989:0:23389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.879015:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614179.879085:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.879139:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035840 going to sleep for 11 seconds 00000100:00100000:2.0:1787614179.880220:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260608 00000100:00100000:2.0:1787614179.880231:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260608 00000100:00100000:2.0:1787614179.880286:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787614179.880297:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:23389:x1874448692260608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614179.880312:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614179.880327:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7af98a00/0x9719586bc2ef0908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0901 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614179.880353:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7af98a00/0x9719586bc2ef0908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0901 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614179.880363:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7af98a00/0x9719586bc2ef0908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0901 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614179.880371:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7af98a00, rc 0) 00000100:00100000:2.0:1787614179.880423:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260608:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614179.880429:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787614179.880708:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614179.880724:0:23389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0908 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.880732:0:23389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0908 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787614179.882770:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787614179.883068:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787614179.883773:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787614179.883804:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787614179.883820:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787614179.883835:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787614179.883850:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787614179.883865:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787614179.883896:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787614179.883912:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787614179.883926:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787614179.883937:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787614179.883948:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787614179.883959:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787614179.883970:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787614179.883981:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787614179.883992:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787614179.884004:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787614179.884015:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787614179.887482:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787614179.887515:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787614179.887531:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787614179.887545:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787614179.887574:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787614179.888792:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787614179.888819:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787614179.888834:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787614179.888848:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787614179.888861:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787614179.888872:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787614179.888883:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787614179.888908:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787614179.888920:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787614179.888932:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787614179.888942:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787614179.888952:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787614179.888963:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787614179.888975:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787614179.888987:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787614179.888999:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787614179.889040:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787614179.889057:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787614179.889070:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787614179.889082:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787614179.889095:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787614179.889107:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787614179.889119:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787614179.889129:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787614179.889142:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787614179.889153:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787614179.889332:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787614179.889353:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787614179.889372:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787614179.889378:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787614179.889481:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614179.889545:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.894519:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e760350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.895070:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260736 00000100:00100000:3.0:1787614179.895081:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260736 00000100:00100000:3.0:1787614179.895137:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787614179.895147:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614179.895333:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260736:12345-0@lo:501:mount.lustre.0 Request processed in 187us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.895348:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787614179.895409:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614179.895456:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614179.895504:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.895530:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e760350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.895545:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260864 00000100:00100000:3.0:1787614179.895548:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260864 00000100:00100000:3.0:1787614179.895570:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787614179.895577:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614179.895669:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260864:12345-0@lo:503:mount.lustre.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.895676:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787614179.895718:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787614179.898667:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787614179.898763:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614179.898844:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.898892:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035840 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.898921:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692260992 00000100:00100000:3.0:1787614179.898930:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692260992 00000100:00100000:3.0:1787614179.899004:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787614179.899014:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614179.899128:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692260992:12345-0@lo:502:mount.lustre.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.899135:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787614179.899219:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692260992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614179.899391:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787614179.899418:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787614179.899431:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787614179.899442:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787614179.899453:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787614179.899466:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787614179.899478:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787614179.899489:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787614179.899502:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787614179.899516:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787614179.899529:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787614179.899543:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787614179.899555:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787614179.899569:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787614179.899583:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787614179.899597:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787614179.899611:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787614179.899638:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787614179.899650:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787614179.899661:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787614179.899672:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787614179.899683:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787614179.899693:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787614179.899705:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787614179.899715:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787614179.899727:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787614179.899739:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787614179.899752:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787614179.899766:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787614179.899780:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787614179.899793:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787614179.899818:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787614179.899832:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787614179.899857:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787614179.899872:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787614179.899885:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787614179.899899:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787614179.899912:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787614179.901844:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787614179.901864:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787614179.901877:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787614179.901888:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787614179.901900:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787614179.901913:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787614179.901927:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787614179.901939:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787614179.904283:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787614179.904336:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787614179.904413:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692261120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614179.904488:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.904543:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035840 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.905061:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261120 00000100:00100000:3.0:1787614179.905068:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261120 00000100:00100000:3.0:1787614179.905114:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787614179.905124:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692261120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614179.905795:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692261120:12345-0@lo:502:mount.lustre.0 Request processed in 669us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.905804:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787614179.905872:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692261120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614179.912425:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1787614179.912491:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1787614179.912543:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692261248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614179.912631:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.912696:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763096c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787614179.914553:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261248 00000100:00100000:0.0:1787614179.914567:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261248 00000100:00100000:0.0:1787614179.914644:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787614179.914654:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692261248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614179.914821:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692261248:12345-0@lo:502:mount.lustre.0 Request processed in 167us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614179.914828:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787614179.915308:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692261248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614179.915406:0:23389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1787614179.915422:0:23389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787614179.918882:0:23408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787614179.918898:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8b5e444119b8) 00000020:00000080:0.0:1787614179.918921:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787614179.919024:0:23408:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5e51a93800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787614179.919038:0:23408:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5e51a93800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787614179.919041:0:23408:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5e51a93800 3 00010000:00080000:0.0:1787614179.919070:0:23408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5e4674e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.155@tcp at head 00010000:00010000:0.0:1787614179.920715:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787614179.922177:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787614179.922224:0:23408:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787614179.922238:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9719586bc2ef0916 00000100:00080000:3.0:1787614179.922248:0:23408:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787614179.922253:0:23408:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b5e4674e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614179.922286:0:23408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f5880 x1874448692261376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614179.922322:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874448692261376:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787614179.922388:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787614179.922455:0:23408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787614179.924092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614179.924102:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787614179.924106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614179.924109:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787614179.924142:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261376 00000100:00100000:3.0:1787614179.924151:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261376 00000100:00100000:3.0:1787614179.924210:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787614179.924219:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692261376:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787614179.924254:0:22655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:3.0:1787614179.924288:0:22655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9719586bc2ef091d 00000004:00100000:3.0:1787614179.924303:0:22655:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787614179.924333:0:22655:0:(import.c:65:import_set_state_nolock()) ffff8b5d43b94800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787614179.924415:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874448692261376:12345-0@lo:38:llog_process_th.0 Request processed in 195us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.924423:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787614179.924465:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5e777f5880 x1874448692261376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787614189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614179.924476:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787614179.924483:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787614179.924490:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787614179.924495:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787614179.924497:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4674e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787614179.924503:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874448692261376:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787614179.933757:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1787614179.933812:0:23389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787614179.933842:0:23389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787614179.933859:0:23389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0908 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.933870:0:23389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0800/0x9719586bc2ef0901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0908 expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787614179.933919:0:23389:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787614179.933921:0:23389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787614179.933926:0:23389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614179.933927:0:23389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614179.933928:0:23389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614179.933929:0:23389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614179.933931:0:23389:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787614179.933932:0:23389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614179.933933:0:23389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787614179.933937:0:23389:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787614179.933939:0:23389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787614179.933954:0:23389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787614179.933955:0:23389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614179.933955:0:23389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614179.933956:0:23389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614179.933957:0:23389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614179.933958:0:23389:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787614179.933959:0:23389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614179.933960:0:23389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787614179.933985:0:23389:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787614179.934002:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692261504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787614179.934076:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.934109:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e760353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.934131:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261504 00000100:00100000:3.0:1787614179.934137:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261504 00000100:00100000:3.0:1787614179.934197:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787614179.934207:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692261504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787614179.934233:0:22650:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787614179.934247:0:22650:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787614179.946711:0:22635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787614179.946748:0:22650:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787614179.946758:0:22650:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787614179.946813:0:22671:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787614179.946817:0:22671:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787614179.946838:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.946872:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 18 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.946881:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.946888:0:22671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.946926:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.947470:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 18 pid: 22650 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.947488:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692261632:0@lo:104: 00000100:00100000:3.0:1787614179.947552:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787614179.947702:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 18 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614179.947711:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 18 pid: 22648 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.947720:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692261760:0@lo:104: 00000100:00100000:3.0:1787614179.947742:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614179.947762:0:22671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.948873:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:23389:x1874448692261504:12345-0@lo:253:mount.lustre.0 Request processed in 14663us (14792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.948885:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787614179.949220:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261632 00000100:00100000:1.0:1787614179.949227:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261632 00000100:00100000:1.0:1787614179.949257:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261760 00000100:00100000:1.0:1787614179.949261:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261760 00000100:00100000:1.0:1787614179.949274:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787614179.949282:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:22671:x1874448692261632:12345-0@lo:104: 00010000:00010000:1.0:1787614179.949298:0:22639:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.949354:0:22639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787614179.949360:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:22671:x1874448692261632:12345-0@lo:104: Request processed in 79us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.949373:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787614179.949388:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787614179.949394:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692261760:12345-0@lo:104: 00010000:00010000:1.0:1787614179.949402:0:22639:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.949436:0:22639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787614179.949441:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692261760:12345-0@lo:104: Request processed in 48us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.949447:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787614179.949488:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692261632:0@lo:104: 00000100:00100000:1.0:1787614179.949500:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692261760:0@lo:104: 00010000:00010000:1.0:1787614179.949527:0:22671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.949544:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787614179.949550:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.949557:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e40031400 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:1.0:1787614179.949561:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.949569:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787614179.949576:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614179.949669:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:23389:1874448692261504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787614179.949681:0:23389:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787614179.949684:0:23389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787614179.949685:0:23389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787614179.949687:0:23389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614179.949688:0:23389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614179.949689:0:23389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614179.949690:0:23389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614179.949691:0:23389:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787614179.949693:0:23389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614179.949694:0:23389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787614179.949704:0:23389:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:01000000:1.0:1787614179.954428:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787614179.954488:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954497:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787614179.954520:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954528:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef08e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef08ec expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954544:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614179.954549:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954554:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98600 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:1.0:1787614179.954557:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954565:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787614179.954571:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614179.954577:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787614179.954588:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954595:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787614179.954608:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954614:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98600/0x9719586bc2ef0821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0828 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954627:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614179.954629:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614179.954631:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614179.954640:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614179.954665:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692261888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787614179.954727:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.954773:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787614179.954779:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692262016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787614179.954799:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.954828:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692261888 00000100:00100000:1.0:1787614179.954835:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692261888 00010000:00010000:1.0:1787614179.954865:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 18 pid: 22650 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614179.954889:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262016 00000100:00100000:1.0:1787614179.954892:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262016 00010000:00010000:1.0:1787614179.954904:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 19 pid: 22648 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614179.954917:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787614179.954925:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:3635:x1874448692261888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787614179.954937:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614179.954942:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 19 pid: 22650 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954967:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 19 pid: 22650 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954980:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f1a00/0x9719586bc2ef08ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef08e5 expref: 19 pid: 22650 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.954995:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614179.955040:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:3635:x1874448692261888:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.955047:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787614179.955063:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787614179.955070:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:3635:x1874448692262016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787614179.955078:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614179.955083:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 17 pid: 22648 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955091:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 17 pid: 22648 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955101:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef0828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef0821 expref: 17 pid: 22648 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955112:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955119:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787614179.955132:0:22640:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008315558s 00010000:00010000:1.0:1787614179.955142:0:22640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955150:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955179:0:22640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955187:0:22640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955192:0:22640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f1c00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614179.955196:0:22640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955203:0:22640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955217:0:22640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955228:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614179.955253:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:3635:x1874448692262016:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.955259:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787614179.955299:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692262016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787614179.955308:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692261888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787614179.955332:0:22671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955351:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614179.955357:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef0924 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1787614179.969205:0:23389:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787614179.969366:0:23414:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787614179.969370:0:23414:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787614179.970202:0:23415:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787614179.970503:0:23389:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787614179.970609:0:23415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787614179.970805:0:23416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23416:1874448692262144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.970866:0:23416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.970889:0:23416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787614179.970941:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262144 00000100:00100000:3.0:1787614179.970949:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262144 00000100:00100000:3.0:1787614179.970987:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787614179.970995:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23416:x1874448692262144:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787614179.971073:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23416:x1874448692262144:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614179.971080:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1787614179.971210:0:23389:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787614179.971240:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787614179.972098:0:23389:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787614179.972108:0:23389:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787614179.972151:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787614179.973650:0:23389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787614179.973875:0:23416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23416:1874448692262144:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787614179.973915:0:23416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787614179.973959:0:23416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23416:1874448692262272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974020:0:23416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.974068:0:23416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787614179.974374:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262272 00000100:00100000:1.0:1787614179.974381:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262272 00000100:00100000:1.0:1787614179.974426:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787614179.974435:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23416:x1874448692262272:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974559:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23416:x1874448692262272:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.974567:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787614179.974598:0:23416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23416:1874448692262272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974653:0:23416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23416:1874448692262400:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974694:0:23416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.974727:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262400 00000100:00100000:1.0:1787614179.974731:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262400 00000100:00100000:1.0:1787614179.974756:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787614179.974762:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23416:x1874448692262400:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974794:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23416:x1874448692262400:12345-0@lo:900:lod0001_rec0000.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614179.974800:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787614179.974819:0:23416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226e40 going to sleep for 11 seconds 00010000:00080000:1.0:1787614179.974834:0:23416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5e7614b480 x1874448692262400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787614195 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614179.974845:0:23416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23416:1874448692262400:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974884:0:23416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23416:1874448692262528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787614179.974909:0:23416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614179.974923:0:23416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226cc0 going to sleep for 11 seconds 00000040:00080000:2.0:1787614179.977343:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787614179.977422:0:23415:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1787614179.978232:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262528 00000100:00100000:2.0:1787614179.978242:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262528 00000100:00100000:2.0:1787614179.978301:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787614179.978311:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23416:x1874448692262528:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787614179.978430:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23416:x1874448692262528:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 120us (3520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614179.978438:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787614179.978490:0:23416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23416:1874448692262528:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787614179.978547:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614179.980700:0:23416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787614179.980770:0:23416:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787614179.980775:0:23416:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1787614179.984755:0:23389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787614179.984892:0:23389:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787614179.985057:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787614179.985506:0:23389:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1787614179.988888:0:23389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787614180.006416:0:23389:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787614180.006457:0:23389:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa02980d9b988 00100000:10000000:3.0:1787614180.006466:0:23389:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787614180.006999:0:23389:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787614180.007044:0:23389:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787614180.007062:0:23389:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787614180.007084:0:23389:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787614180.011835:0:23389:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787614180.012076:0:23389:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787614180.210700:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614180.785369:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00000040:00080000:1.0:1787614181.042221:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787614181.105335:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787614181.105344:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e51a93800 from 12 10000000:01000000:1.0:1787614181.105349:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787614181.105395:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.105421:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.105432:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614181.105458:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692262656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787614181.105521:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614181.105576:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787614181.105718:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262656 00000100:00100000:3.0:1787614181.105725:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262656 00000100:00100000:3.0:1787614181.105776:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787614181.105787:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:22652:x1874448692262656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787614181.105799:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614181.105813:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef092b expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.105836:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef092b expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.105846:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef092b expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.105854:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f0000, rc 0) 00000100:00100000:3.0:1787614181.105914:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692262656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614181.105921:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787614181.106056:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692262656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787614181.106071:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.106080:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614181.106130:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692262784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787614181.106202:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614181.106220:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787614181.106469:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262784 00000100:00100000:3.0:1787614181.106474:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262784 00000100:00100000:3.0:1787614181.106509:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787614181.106517:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4521b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692262784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787614181.106540:0:22650:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787614181.106569:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787614181.106573:0:22650:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787614181.106655:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4521b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692262784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614181.106662:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787614181.106876:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692262784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787614181.106926:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787614181.106933:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.106942:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614181.106961:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787614181.106963:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e7af67800 from 12 10000000:01000000:1.0:1787614181.106966:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787614181.106984:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.106991:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.106999:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614181.107013:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692262912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787614181.107050:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614181.107115:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787614181.107498:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692262912 00000100:00100000:0.0:1787614181.107505:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692262912 00000100:00100000:3.0:1787614181.109737:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787614181.109761:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692262912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787614181.109780:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614181.109802:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0939 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.109830:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.109840:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.109849:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f0a00, rc 0) 00000100:00100000:3.0:1787614181.109956:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692262912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614181.109963:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787614181.110193:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692262912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787614181.110211:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614181.110222:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614181.110286:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692263040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787614181.110324:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614181.110358:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787614181.110662:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263040 00000100:00100000:3.0:1787614181.110669:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263040 00000100:00100000:3.0:1787614181.110715:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787614181.110722:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692263040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787614181.110736:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787614181.110756:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787614181.110759:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787614181.110847:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692263040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614181.110854:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787614181.111071:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692263040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787614181.111114:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787614181.111121:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614181.111129:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614181.238795:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614181.819776:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00000040:00080000:1.0:1787614182.065808:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787614182.264001:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614182.834241:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787614183.281304:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614183.857332:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787614184.306807:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787614184.587337:0:23660:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787614184.884115:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1787614185.265885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787614185.265892:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787614185.265895:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614185.265905:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8b5e48346000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614185.265926:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c5180 x1874448692263296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614185.265953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614185.265957:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614185.265960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614185.265963:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614185.265987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614185.265990:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614185.265993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614185.265995:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787614185.266035:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692263168:0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.266107:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614185.266177:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787614185.266184:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692263424:0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.266213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614185.266248:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692263296:0@lo:38:kworker.0 00000100:00100000:0.0:1787614185.266282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614185.266312:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692263552:0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.266336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614185.266355:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787614185.266360:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874448692263680:0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.266385:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614185.266417:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263168 00000100:00100000:0.0:1787614185.266424:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263168 00000100:00100000:0.0:1787614185.266468:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787614185.266476:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4521a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:3637:x1874448692263168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.266532:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4521a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:3637:x1874448692263168:12345-0@lo:400:kworker.0 Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614185.266539:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787614185.267042:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263296 00000100:00100000:0.0:1787614185.267049:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263296 00000100:00100000:0.0:1787614185.267069:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263552 00000100:00100000:0.0:1787614185.267071:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263552 00000100:00100000:0.0:1787614185.267089:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787614185.267094:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1874448692263296:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787614185.267117:0:23398:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:0.0:1787614185.267151:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef0947 00000004:00100000:0.0:1787614185.267188:0:23398:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787614185.267193:0:23398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1787614185.267264:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263424 00000100:00100000:0.0:1787614185.267268:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263424 00000100:00100000:0.0:1787614185.267293:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263680 00000100:00100000:0.0:1787614185.267296:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263680 00000100:00100000:0.0:1787614185.267319:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787614185.267325:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692263424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.267565:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692263424:12345-0@lo:400:kworker.0 Request processed in 239us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614185.267572:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787614185.267586:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787614185.267592:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874448692263680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.267626:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874448692263680:12345-0@lo:400:kworker.0 Request processed in 34us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614185.267633:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787614185.267674:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e763c4a80 x1874448692263680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614185.267700:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874448692263680:0@lo:400:kworker.0 00010000:00080000:0.0:1787614185.267732:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e763c5c00 x1874448692263424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614185.267740:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692263424:0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.267749:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692263168:0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.272493:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614185.272526:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692263552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614185.272635:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692263552:12345-0@lo:400:kworker.0 Request processed in 128us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614185.272642:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614185.272707:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692263552:0@lo:400:kworker.0 00000100:00100000:1.0:1787614185.274139:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614185.274179:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692263808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787614185.274238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614185.274423:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263808 00000100:00100000:2.0:1787614185.274431:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263808 00000100:00100000:2.0:1787614185.274479:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787614185.274488:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692263808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787614185.274517:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787614185.274568:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692263808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614185.274575:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787614185.274648:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692263808:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787614185.309337:0:23398:0:(import.c:65:import_set_state_nolock()) ffff8b5e48566000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787614185.309485:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1874448692263296:12345-0@lo:38:kworker.0 Request processed in 42387us (43200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614185.309496:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787614185.309576:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787614185.309585:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787614185.309591:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787614185.309599:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48346000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787614185.309618:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000629de9e3): req@ffff8b5e763c7800 x1874448692256256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614185.309743:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614185.309760:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787614185.309771:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692263936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614185.309778:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787614185.309797:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614185.309849:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692263296:0@lo:38:kworker.0 00000100:00100000:2.0:1787614185.309901:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692256256 00000100:00100000:2.0:1787614185.309907:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692256256 00000100:00100000:2.0:1787614185.309975:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692263936 00000100:00100000:2.0:1787614185.309979:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692263936 00000100:00100000:1.0:1787614185.310019:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787614185.310030:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22697:x1874448692256256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787614185.310103:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22697:x1874448692256256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614185.310109:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787614185.310124:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787614185.310131:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874448692263936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787614185.310153:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787614185.310217:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874448692263936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614185.310223:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787614185.310249:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692263936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614185.310291:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22697:1874448692256256:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787614185.310324:0:22697:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787614185.310357:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22697:1874448692264064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787614185.310386:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614185.310424:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787614185.310492:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264064 00000100:00100000:0.0:1787614185.310496:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264064 00000100:00100000:0.0:1787614185.310567:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787614185.310574:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22697:x1874448692264064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787614185.310682:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22697:x1874448692264064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614185.310688:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787614185.310750:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22697:1874448692264064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787614185.310816:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22697:1874448692264192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787614185.310839:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614185.310863:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4556a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787614185.310912:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264192 00000100:00100000:0.0:1787614185.310916:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264192 00000100:00100000:0.0:1787614185.310934:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787614185.310940:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22697:x1874448692264192:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787614185.310995:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22697:x1874448692264192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614185.311012:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787614185.311071:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22697:1874448692264192:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787614185.311124:0:22697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787614185.313260:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787614185.313333:0:22697:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1787614185.313340:0:22697:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787614185.330319:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787614185.517053:0:23712:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787614185.517763:0:23712:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1787614186.347631:0:23762:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787614186.347983:0:23762:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787614186.360985:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787614187.331764:0:23810:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0ecf4660 20000000:00000080:1.0:1787614187.331785:0:23810:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b5e51400c00 uarg=0000000000000000 20000000:01000000:1.0:1787614187.331824:0:23810:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787614187.331831:0:23810:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787614187.331836:0:23810:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787614187.332907:0:23811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787614187.333105:0:23810:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787614187.347860:0:23810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787614187.347891:0:23810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614187.347909:0:23810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614187.347917:0:23810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614187.347924:0:23810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614187.347967:0:23810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614187.347981:0:23810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 17 pid: 22648 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614187.348009:0:23810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23810:1874448692264320:0@lo:104: 00000100:00100000:1.0:1787614187.348075:0:23810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787614187.348136:0:23810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614187.348144:0:23810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614187.348284:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264320 00000100:00100000:2.0:1787614187.348293:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264320 00000100:00100000:2.0:1787614187.348341:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787614187.348350:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:23810:x1874448692264320:12345-0@lo:104: 00010000:00010000:2.0:1787614187.348363:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.348425:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787614187.348430:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:23810:x1874448692264320:12345-0@lo:104: Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614187.348437:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787614187.348530:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614187.348537:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.348544:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41668200 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:0.0:1787614187.348547:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.348566:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787614187.348574:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614187.348578:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787614187.348613:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.348619:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787614187.348637:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.348643:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e41668200/0x9719586bc2ef08f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef08fa expref: -99 pid: 23389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.348655:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614187.348657:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614187.348659:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614187.348670:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692264576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614187.348698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614187.348750:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264576 00000100:00100000:0.0:1787614187.348754:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264576 00010000:00010000:0.0:1787614187.348773:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 18 pid: 22648 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614187.348794:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787614187.348800:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:3635:x1874448692264576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787614187.348816:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614187.348822:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 18 pid: 22648 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614187.348981:0:23810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23810:1874448692264448:0@lo:104: 00000100:00100000:1.0:1787614187.349015:0:23810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614187.349038:0:23810:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e672260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787614187.349054:0:23810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23810:1874448692264320:0@lo:104: 00000100:00100000:2.0:1787614187.350694:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264448 00000100:00100000:2.0:1787614187.350706:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264448 00000100:00100000:2.0:1787614187.350766:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787614187.350777:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:23810:x1874448692264448:12345-0@lo:104: 00010000:00010000:2.0:1787614187.350793:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.350871:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787614187.350877:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:23810:x1874448692264448:12345-0@lo:104: Request processed in 103us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614187.350883:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787614187.350905:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614187.350910:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.350918:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f1200 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614187.350921:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.350929:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614187.350936:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614187.350960:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787614187.351007:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.351014:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614187.351034:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.351041:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef07f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef07f7 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614187.351059:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614187.351061:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614187.351062:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614187.351323:0:23810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23810:1874448692264448:0@lo:104: 00010000:00010000:0.0:1787614187.353189:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 18 pid: 22648 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353216:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef08fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef08f3 expref: 18 pid: 22648 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353233:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614187.353527:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692264704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614187.353600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614187.353696:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:3635:x1874448692264576:12345-0@lo:103:ldlm_bl.0 Request processed in 4894us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614187.353706:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787614187.353731:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264704 00000100:00100000:0.0:1787614187.353738:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264704 00010000:00010000:0.0:1787614187.353766:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614187.353797:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787614187.353806:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:3636:x1874448692264704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787614187.353819:0:22642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614187.353825:0:22642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353835:0:22642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353865:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669000/0x9719586bc2ef07f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef07f0 expref: 17 pid: 22649 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353877:0:22642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353885:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353900:0:22642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353906:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353913:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353920:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353926:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41669800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614187.353930:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353938:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353946:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.353966:0:22642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614187.354008:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:3636:x1874448692264704:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614187.354014:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787614187.354049:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692264704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614187.354630:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692264576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787614187.355486:0:23810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.355867:0:23810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.355875:0:23810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.355881:0:23810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669800/0x9719586bc2ef094e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614187.382626:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787614187.892468:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787614188.401329:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787614189.042450:0:22652:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787614189.042459:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5e51a93800 from 13 10000000:01000000:3.0:1787614189.042464:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787614189.042508:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614189.042519:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614189.042530:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614189.042553:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692264832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.042615:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.042674:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5244c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787614189.042766:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264832 00000100:00100000:1.0:1787614189.042774:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264832 00000100:00100000:1.0:1787614189.042828:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787614189.042838:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+16:22652:x1874448692264832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787614189.042853:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614189.042867:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0955 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614189.042891:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614189.042902:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614189.042913:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41669e00, rc 0) 00000100:00100000:1.0:1787614189.042958:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692264832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614189.042965:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787614189.044320:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692264832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787614189.044345:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614189.044357:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614189.044440:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692264960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.044494:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.044525:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5244c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787614189.044597:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692264960 00000100:00100000:1.0:1787614189.044603:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692264960 00000100:00100000:1.0:1787614189.044646:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787614189.044655:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4521b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692264960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787614189.044768:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4521b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692264960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614189.044775:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787614189.044908:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692264960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.044935:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.044973:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.045010:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5244c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614189.045055:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265088 00000100:00100000:2.0:1787614189.045059:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265088 00000100:00100000:2.0:1787614189.045099:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787614189.045106:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692265088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787614189.045215:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692265088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614189.045221:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787614189.045423:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787614189.046279:0:23883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787614189.046582:0:22652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787614189.046603:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787614189.046613:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614189.046624:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614189.046648:0:22652:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787614189.046651:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5e7af67800 from 13 10000000:01000000:2.0:1787614189.046653:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787614189.046684:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614189.046691:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614189.046699:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614189.046719:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787614189.046764:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614189.046802:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787614189.046858:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265216 00000100:00100000:1.0:1787614189.046865:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265216 00000100:00100000:1.0:1787614189.046915:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787614189.046924:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+17:22652:x1874448692265216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787614189.046935:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614189.046947:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0963 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614189.046966:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614189.046976:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614189.046994:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41669400, rc 0) 00000100:00100000:1.0:1787614189.047035:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692265216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614189.047042:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787614189.047364:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787614189.047380:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614189.047388:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614189.047443:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.047471:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.047508:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5244c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787614189.047795:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265344 00000100:00100000:1.0:1787614189.047800:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265344 00000100:00100000:1.0:1787614189.047839:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787614189.047847:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692265344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787614189.047996:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692265344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614189.048002:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787614189.051586:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.051648:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.051721:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.051761:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5244c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787614189.051781:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265472 00000100:00100000:3.0:1787614189.051787:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265472 00000100:00100000:3.0:1787614189.051841:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787614189.051849:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692265472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787614189.051988:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:22652:x1874448692265472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614189.051996:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787614189.052046:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692265472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787614189.052722:0:23884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787614189.052772:0:22652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787614189.052792:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787614189.052808:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614189.052820:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614189.374551:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614179/real 1787614179] req@ffff8b5e76148380 x1874448692259584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614189 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614189.374595:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e76148380 x1874448692259584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614189 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614189.374606:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614179/real 1787614179] req@ffff8b5e7614b100 x1874448692259456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614189 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614189.374618:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e7614b100 x1874448692259456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614189 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787614189.374638:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787614189.374661:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787614189.374665:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692259584:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787614189.374670:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e454fd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787614189.374675:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787614189.374678:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692259456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787614189.375234:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614189.375239:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787614189.375242:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614189.375245:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787614189.375261:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692265600:0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.375325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.375375:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265600 00000100:00100000:3.0:1787614189.375382:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265600 00000100:00100000:3.0:1787614189.375467:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787614189.375476:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874448692265600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.375544:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874448692265600:12345-0@lo:400:kworker.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614189.375551:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787614189.375593:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692265600:0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.375620:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614189.375625:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692265728:0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.375654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.375682:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265728 00000100:00100000:3.0:1787614189.375686:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265728 00000100:00100000:3.0:1787614189.375712:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787614189.375719:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692265728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.375753:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692265728:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614189.375760:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787614189.375787:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e777f5500 x1874448692265728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614189.375798:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692265728:0@lo:400:kworker.0 00000100:00080000:3.0:1787614189.375825:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614189.375829:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787614189.375831:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e454fd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614189.375835:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:3.0:1787614189.375839:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787614189.375843:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8b5e454fd800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614189.375852:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692265856:0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.375883:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.375943:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f5180 x1874448692265984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787614189.375956:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614189.375959:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787614189.375961:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614189.375964:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:3.0:1787614189.375967:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787614189.375970:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8b5e48565800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614189.375992:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e777f4700 x1874448692266112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614189.376019:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692266240:0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.376044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614189.376075:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692266240 00000100:00100000:3.0:1787614189.376080:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692266240 00000100:00100000:3.0:1787614189.376101:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787614189.376107:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692266240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614189.376142:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692266240:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614189.376148:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787614189.376197:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e777f7b80 x1874448692266240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614189.376206:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692266240:0@lo:400:kworker.0 00000100:00100000:1.0:1787614189.376575:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692265856 00000100:00100000:1.0:1787614189.376580:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692265856 00000100:00100000:1.0:1787614189.376615:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787614189.376623:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692265856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614189.376668:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692265856:12345-0@lo:400:kworker.0 Request processed in 46us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614189.376686:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787614189.376719:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692265856:0@lo:400:kworker.0 00000100:00100000:1.0:1787614189.376738:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692265984:0@lo:8:kworker.0 00000400:00000100:1.0:1787614189.376763:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692265984 offset 0 length 520: 4 00000100:00100000:1.0:1787614189.376784:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692266112:0@lo:8:kworker.0 00000400:00000100:1.0:1787614189.376803:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692266112 offset 0 length 520: 4 00010000:00010000:0.0:1787614189.426341:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614190.387096:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614175/real 1787614175] req@ffff8b5e763c6300 x1874448692257280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614190.387130:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e763c6300 x1874448692257280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614190.387142:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614175/real 1787614175] req@ffff8b5e763c5500 x1874448692257408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614190.387154:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e763c5500 x1874448692257408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787614190.387192:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787614190.387219:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787614190.387223:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692257280:0@lo:8:kworker.0 00000100:00080000:1.0:1787614190.387229:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787614190.387234:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787614190.387237:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692257408:0@lo:8:kworker.0 00000100:00100000:1.0:1787614190.387265:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614190.387276:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692266368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787614190.387372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787614190.387433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614190.387438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787614190.387441:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787614190.387447:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:1.0:1787614190.387452:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787614190.387460:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b5e4608e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1787614190.387484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e76149180 x1874448692266624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787614190.387498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614190.387502:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787614190.387503:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787614190.387507:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:1.0:1787614190.387509:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787614190.387513:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b5e67931800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1787614190.387524:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e7614aa00 x1874448692266752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787614190.387553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614190.387557:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787614190.387560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614190.387563:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787614190.387589:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692266496:0@lo:400:kworker.0 00000100:00100000:1.0:1787614190.387622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614190.387816:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692267136:0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.387859:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614190.387903:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614190.387909:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692267264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614190.387933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614190.387989:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692266368 00000100:00100000:3.0:1787614190.387998:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692266368 00000100:00100000:3.0:1787614190.388047:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267264 00000100:00100000:3.0:1787614190.388050:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267264 00000100:00100000:3.0:1787614190.388065:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787614190.388074:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1874448692266368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787614190.388114:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787614190.388175:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1874448692266368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614190.388183:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787614190.388201:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787614190.388206:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692267264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787614190.388223:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787614190.388253:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692267264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614190.388259:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787614190.388275:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692267008:0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.388296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614190.388312:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787614190.388316:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874448692266880:0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.388335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614190.388357:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267136 00000100:00100000:3.0:1787614190.388367:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267136 00000100:00100000:3.0:1787614190.388390:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692266880 00000100:00100000:3.0:1787614190.388392:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692266880 00000100:00100000:3.0:1787614190.388403:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787614190.388409:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692267136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.388440:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692267136:12345-0@lo:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614190.388446:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787614190.388455:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787614190.388459:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874448692266880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.388482:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874448692266880:12345-0@lo:400:kworker.0 Request processed in 22us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614190.388487:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787614190.388501:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267008 00000100:00100000:3.0:1787614190.388504:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267008 00000100:00100000:3.0:1787614190.388517:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787614190.388522:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692267008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.388552:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692267008:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614190.388558:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787614190.388607:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692267264:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787614190.388624:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e7614a680 x1874448692267136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614190.388634:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692267136:0@lo:400:kworker.0 00010000:00080000:3.0:1787614190.388896:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e7614bb80 x1874448692266880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614190.388920:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874448692266880:0@lo:400:kworker.0 00000100:00100000:3.0:1787614190.388934:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692267008:0@lo:400:kworker.0 00000100:00100000:1.0:1787614190.389238:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692266368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787614190.389266:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692266624:0@lo:8:kworker.0 00000400:00000100:1.0:1787614190.389317:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692266624 offset 0 length 520: 4 00000100:00100000:1.0:1787614190.389334:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692266752:0@lo:8:kworker.0 00000400:00000100:1.0:1787614190.389356:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874448692266752 offset 0 length 520: 4 00000100:00100000:2.0:1787614190.392022:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692266496 00000100:00100000:2.0:1787614190.392044:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692266496 00000100:00100000:2.0:1787614190.392117:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787614190.392129:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:3638:x1874448692266496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614190.392272:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:3638:x1874448692266496:12345-0@lo:400:kworker.0 Request processed in 145us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614190.392280:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787614190.392589:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692266496:0@lo:400:kworker.0 00010000:00010000:2.0:1787614190.450792:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787614190.900532:0:23390:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787614191.475592:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787614192.305867:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787614192.499887:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614193.526700:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614194.545367:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787614194.566396:0:24158:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787614194.566399:0:24158:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787614194.566401:0:24158:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787614194.566513:0:24158:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b5d4322b000 00000020:01000004:1.0:1787614194.566529:0:24158:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787614194.566542:0:24158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787614194.566556:0:24158:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8b5e755499b8) 00000020:00000080:1.0:1787614194.566573:0:24158:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787614194.644576:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787614194.650564:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787614194.651068:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787614194.651340:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787614194.651636:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787614194.657388:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787614194.658142:0:24158:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1787614194.659049:0:24158:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787614194.659357:0:24158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787614194.659369:0:24158:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787614194.659381:0:24158:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9719586bc2ef0978 00000020:01000004:2.0:1787614194.659388:0:24158:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787614194.659408:0:24158:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787614194.659411:0:24158:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787614194.659417:0:24158:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787614194.659421:0:24158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787614194.659433:0:24158:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8b5d432e4d28) 00000020:00000080:2.0:1787614194.659444:0:24158:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787614194.660651:0:24158:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787614194.660798:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787614194.660804:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787614194.664053:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787614194.664068:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787614194.665831:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787614194.665840:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787614194.670817:0:24158:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787614194.671021:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787614194.671028:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787614194.672650:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787614194.672662:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787614194.694061:0:24158:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787614194.694757:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787614194.694764:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787614194.696001:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787614194.696012:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787614194.696730:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787614194.696738:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787614194.704607:0:24158:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787614194.704793:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787614194.704799:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787614194.705752:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787614194.705801:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787614194.759558:0:24158:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787614194.759741:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787614194.759746:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787614194.761012:0:24158:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787614194.761022:0:24158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787614194.766396:0:24158:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787614194.766430:0:24158:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787614194.766437:0:24158:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787614194.783576:0:24158:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787614194.783793:0:24158:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.155@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787614194.783798:0:24158:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787614194.783800:0:24158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787614194.783801:0:24158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787614194.783802:0:24158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787614194.783804:0:24158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787614194.783805:0:24158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787614194.783807:0:24158:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787614194.783809:0:24158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787614194.783810:0:24158:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787614194.783814:0:24158:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787614194.783816:0:24158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787614194.783817:0:24158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787614194.783818:0:24158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787614194.783819:0:24158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787614194.783820:0:24158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787614194.783821:0:24158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787614194.783822:0:24158:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787614194.783829:0:24158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787614194.783830:0:24158:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787614194.784100:0:24158:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787614194.784123:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267392:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787614194.784480:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.784529:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76035240 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.784597:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267392 00000100:00100000:3.0:1787614194.784605:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267392 00000100:00100000:3.0:1787614194.784654:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787614194.784662:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:24158:x1874448692267392:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787614194.784691:0:22648:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787614194.784694:0:22648:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787614194.784698:0:22648:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787614194.785044:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:24158:x1874448692267392:12345-0@lo:253:mount.lustre.0 Request processed in 381us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.785052:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787614194.785129:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787614194.785138:0:24158:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787614194.785141:0:24158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787614194.785142:0:24158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787614194.785152:0:24158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614194.785153:0:24158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614194.785154:0:24158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614194.785181:0:24158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614194.785183:0:24158:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614194.785184:0:24158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614194.785185:0:24158:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787614194.785203:0:24158:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5d4322b000 from lustre-OST0000 10000000:01000000:2.0:1787614194.785228:0:24158:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787614194.785231:0:24158:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787614194.785238:0:24158:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b5e7afb19b8 local copy 00010000:00010000:2.0:1787614194.785247:0:24158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614194.785342:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614194.785372:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.785396:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e61661300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.785496:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267520 00000100:00100000:3.0:1787614194.785501:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267520 00000100:00100000:3.0:1787614194.785533:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787614194.785541:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:24158:x1874448692267520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614194.785625:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:24158:x1874448692267520:12345-0@lo:501:mount.lustre.0 Request processed in 85us (251us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787614194.785632:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787614194.785703:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267520:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787614194.785716:0:24158:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787614194.785735:0:24158:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787614194.785740:0:24158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.785747:0:24158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614194.785769:0:24158:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5d4322b000 10000000:01000000:1.0:1787614194.785774:0:24158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787614194.785778:0:24158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787614194.785781:0:24158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787614194.785784:0:24158:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787614194.785787:0:24158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787614194.785808:0:24158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.785815:0:24158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.785822:0:24158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614194.785833:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787614194.785882:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614194.785905:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e82055600 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.786069:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267648 00000100:00100000:3.0:1787614194.786080:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267648 00000100:00100000:3.0:1787614194.786113:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787614194.786121:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+18:24158:x1874448692267648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614194.786129:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614194.786142:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f1400/0x9719586bc2ef098d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0986 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.786190:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f1400/0x9719586bc2ef098d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0986 expref: 19 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.786199:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f1400/0x9719586bc2ef098d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0986 expref: 19 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.786208:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f1400, rc 0) 00000100:00100000:3.0:1787614194.786240:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692267648:12345-0@lo:101:mount.lustre.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.786246:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787614194.786335:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614194.786348:0:24158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef098d expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.786356:0:24158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef098d expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787614194.791361:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787614194.793228:0:24158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614194.798261:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787614194.798320:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787614194.798337:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787614194.798349:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787614194.798364:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787614194.798376:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787614194.798411:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787614194.798427:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787614194.798440:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787614194.798454:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787614194.798467:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787614194.798481:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787614194.798505:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787614194.798511:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787614194.798637:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614194.798703:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614194.798748:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d421a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.799041:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267776 00000100:00100000:3.0:1787614194.799049:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267776 00000100:00100000:3.0:1787614194.799099:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787614194.799109:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692267776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614194.799317:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692267776:12345-0@lo:501:mount.lustre.0 Request processed in 209us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.799326:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787614194.799456:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614194.799612:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614194.799652:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.799682:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e61661540 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.799742:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692267904 00000100:00100000:3.0:1787614194.799747:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692267904 00000100:00100000:3.0:1787614194.799781:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787614194.799789:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692267904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614194.800465:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692267904:12345-0@lo:503:mount.lustre.0 Request processed in 673us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614194.800572:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692267904:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787614194.800996:0:24158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787614194.801083:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614194.801129:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614194.801150:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.801243:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787614194.801280:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268032 00000100:00100000:3.0:1787614194.801286:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268032 00000100:00100000:3.0:1787614194.801308:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787614194.801316:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692268032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614194.801967:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692268032:12345-0@lo:502:mount.lustre.0 Request processed in 649us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.801975:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787614194.802408:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614194.804653:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787614194.804839:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787614194.804857:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787614194.804872:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787614194.804885:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787614194.804899:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787614194.804912:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787614194.804925:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787614194.804937:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1787614194.804964:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1787614194.804980:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1787614194.805006:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1787614194.805116:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614194.805256:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614194.805590:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268160 00000100:00100000:3.0:1787614194.805600:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268160 00000100:00100000:3.0:1787614194.805666:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787614194.805679:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692268160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614194.805793:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692268160:12345-0@lo:502:mount.lustre.0 Request processed in 117us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.805801:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787614194.805806:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e616610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614194.805833:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614194.805892:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787614194.805901:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787614194.809985:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787614194.809997:0:24175:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787614194.810004:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.810006:0:24175:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787614194.810013:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787614194.810028:0:24175:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b5d432e3370) 00000020:00000080:2.0:1787614194.810055:0:24175:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787614194.810062:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787614194.810143:0:24175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5d4322b000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787614194.810151:0:24175:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787614194.810188:0:24175:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9719586bc2ef099b 00010000:00010000:2.0:1787614194.814661:0:24175:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787614194.815554:0:24175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787614194.817623:0:24175:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787614194.824417:0:24175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787614194.824429:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614194.824438:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614194.824440:0:24175:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787614194.824445:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787614194.824447:0:24175:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787614194.824449:0:24175:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787614194.824451:0:24175:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787614194.824452:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787614194.824455:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614194.824456:0:24175:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787614194.832372:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614194.832384:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614194.832387:0:24175:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787614194.832391:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787614194.832393:0:24175:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787614194.832396:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614194.832399:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614194.832400:0:24175:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787614194.832402:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787614194.832404:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614194.832406:0:24175:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787614194.832410:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787614194.832444:0:24175:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787614194.832447:0:24175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787614194.832449:0:24175:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787614194.832452:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1787614194.832683:0:24158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787614194.832716:0:24158:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787614194.832745:0:24158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef098d expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.832755:0:24158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e41669800/0x9719586bc2ef0986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef098d expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787614194.832764:0:24158:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5d4322b000 from 1 10000000:01000000:1.0:1787614194.832766:0:24158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787614194.832799:0:24158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.832806:0:24158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.832815:0:24158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614194.832837:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787614194.832916:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614194.832963:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d421a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.832990:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268288 00000100:00100000:1.0:1787614194.832996:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268288 00000100:00100000:1.0:1787614194.833032:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787614194.833041:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:24158:x1874448692268288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614194.833053:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614194.833064:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef09a2 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.833084:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.833107:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.833116:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41669a00, rc 0) 00000100:00100000:1.0:1787614194.833181:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268288:12345-0@lo:101:mount.lustre.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.833189:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787614194.833240:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614194.833258:0:24158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614194.833267:0:24158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787614194.835029:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787614194.839537:0:24158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787614194.839765:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787614194.839790:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787614194.839804:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787614194.839817:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787614194.839831:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787614194.839844:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787614194.839856:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787614194.839885:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787614194.839901:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787614194.839915:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787614194.839929:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787614194.839965:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787614194.839972:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787614194.840057:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614194.840121:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614194.840204:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226780 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.842107:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268416 00000100:00100000:1.0:1787614194.842121:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268416 00000100:00100000:1.0:1787614194.842203:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787614194.842213:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614194.842375:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268416:12345-0@lo:501:mount.lustre.0 Request processed in 164us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.842382:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787614194.845059:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614194.845121:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614194.845220:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.845340:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67226780 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.845343:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268544 00000100:00100000:1.0:1787614194.845352:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268544 00000100:00100000:1.0:1787614194.845401:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787614194.845410:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614194.845541:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268544:12345-0@lo:503:mount.lustre.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.845557:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787614194.845571:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787614194.847183:0:24158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787614194.848260:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614194.848335:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.848370:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e47c6cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.848884:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268672 00000100:00100000:1.0:1787614194.848904:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268672 00000100:00100000:1.0:1787614194.848968:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787614194.848978:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614194.850842:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268672:12345-0@lo:502:mount.lustre.0 Request processed in 1856us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.850855:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787614194.851399:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614194.851652:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787614194.851687:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787614194.851700:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787614194.851711:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787614194.851723:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787614194.851734:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787614194.851747:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787614194.851758:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787614194.851769:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787614194.851780:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787614194.851792:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787614194.851826:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614194.851897:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614194.851943:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268800 00000100:00100000:3.0:1787614194.851946:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.851963:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268800 00000100:00100000:1.0:1787614194.852009:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787614194.852018:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614194.852133:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268800:12345-0@lo:502:mount.lustre.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.852140:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787614194.852391:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614194.852438:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787614194.852447:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787614194.854116:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614194.854136:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.854138:0:24179:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787614194.854147:0:24179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5d4322b000 00000020:00000080:2.0:1787614194.854149:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614194.854342:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614194.854620:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.854622:0:24179:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787614194.854627:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614194.854631:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.854632:0:24179:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787614194.854636:0:24179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5d4322b000 00000020:00000080:2.0:1787614194.854638:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614194.854732:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614194.854736:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.854738:0:24179:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787614194.854740:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614194.854743:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.854744:0:24179:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787614194.854748:0:24179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5d4322b000 00000020:00000080:2.0:1787614194.854749:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614194.866985:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614194.867025:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.867027:0:24179:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787614194.867033:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787614194.867037:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.867039:0:24179:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787614194.867043:0:24179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5d4322b000 00000020:00000080:2.0:1787614194.867046:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787614194.867103:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787614194.867107:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787614194.867109:0:24179:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787614194.867112:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787614194.867301:0:24158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787614194.867333:0:24158:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787614194.867356:0:24158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.867369:0:24158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787614194.867454:0:24158:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787614194.867457:0:24158:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5d4322b000 10000000:01000000:3.0:1787614194.867460:0:24158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5d4322b000 10000000:01000000:3.0:1787614194.867464:0:24158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787614194.867481:0:24158:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5d4322b000 from 1 10000000:01000000:3.0:1787614194.867484:0:24158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787614194.867519:0:24158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.867528:0:24158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.867539:0:24158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614194.867566:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787614194.867632:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614194.867686:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e52abc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787614194.869244:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692268928 00000100:00100000:3.0:1787614194.869259:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692268928 00000100:00100000:3.0:1787614194.869321:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787614194.869332:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:24158:x1874448692268928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614194.869348:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614194.869365:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef09b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef09b0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.869395:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef09b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef09b0 expref: 21 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.869424:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f1c00/0x9719586bc2ef09b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09b0 expref: 21 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.869433:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f1c00, rc 0) 00000100:00100000:3.0:1787614194.869526:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692268928:12345-0@lo:101:mount.lustre.0 Request processed in 197us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.869533:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787614194.869596:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692268928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614194.869614:0:24158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09b7 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614194.869623:0:24158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef09b7 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787614194.876027:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1787614194.876380:0:24158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787614194.876571:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787614194.876595:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787614194.876608:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787614194.876634:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787614194.876648:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787614194.876660:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787614194.876670:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787614194.876681:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787614194.876693:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787614194.876704:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787614194.876717:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787614194.876728:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787614194.876741:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787614194.876752:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787614194.876764:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787614194.876777:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787614194.876788:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787614194.876800:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787614194.876812:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787614194.876838:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787614194.876852:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787614194.876865:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787614194.876876:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787614194.876889:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787614194.876899:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787614194.876911:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787614194.876923:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787614194.876935:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787614194.876957:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787614194.876973:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787614194.876986:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787614194.876998:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787614194.877010:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787614194.877034:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787614194.877048:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787614194.877074:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787614194.877087:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787614194.877098:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787614194.877107:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787614194.877119:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787614194.877130:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787614194.877141:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787614194.877152:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787614194.877191:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787614194.877203:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787614194.877215:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787614194.877225:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787614194.877235:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787614194.877337:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787614194.877357:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787614194.877389:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787614194.877396:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787614194.877478:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614194.877540:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.877585:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e602f49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.881541:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269056 00000100:00100000:1.0:1787614194.881557:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269056 00000100:00100000:1.0:1787614194.881631:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787614194.881652:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614194.882123:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269056:12345-0@lo:501:mount.lustre.0 Request processed in 471us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.882132:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787614194.882709:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787614194.882759:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787614194.882812:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614194.882851:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e45540600 going to sleep for 11 seconds 00000100:00100000:2.0:1787614194.883198:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269184 00000100:00100000:2.0:1787614194.883206:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269184 00000100:00100000:2.0:1787614194.883254:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787614194.883262:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614194.883370:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269184:12345-0@lo:503:mount.lustre.0 Request processed in 108us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614194.883378:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787614194.885635:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787614194.886079:0:24158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787614194.886181:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614194.886259:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614194.886305:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e45540600 going to sleep for 11 seconds 00000100:00100000:1.0:1787614194.886319:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269312 00000100:00100000:1.0:1787614194.886326:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269312 00000100:00100000:1.0:1787614194.886372:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787614194.886382:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614194.886644:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269312:12345-0@lo:502:mount.lustre.0 Request processed in 262us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614194.886652:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787614194.887723:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787614194.887990:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787614194.888020:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787614194.888034:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787614194.888063:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787614194.888079:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787614194.888090:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787614194.888102:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787614194.888115:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787614194.888128:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787614194.888140:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787614194.888153:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787614194.888188:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787614194.888202:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787614194.888215:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787614194.888226:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787614194.888237:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787614194.888248:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787614194.888260:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787614194.888271:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787614194.888298:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787614194.888313:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787614194.888326:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787614194.888339:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787614194.888352:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787614194.888364:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787614194.888376:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787614194.888387:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787614194.888399:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787614194.888410:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787614194.888421:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787614194.888432:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787614194.888442:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787614194.888463:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787614194.889064:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787614194.889091:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787614194.889119:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787614194.889137:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787614194.889155:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787614194.889195:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787614194.889217:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787614194.889238:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787614194.889249:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787614194.889264:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787614194.889283:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787614194.889303:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787614194.889320:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787614194.889338:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787614194.889353:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787614194.889404:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614194.889491:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614194.889537:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269440 00000100:00100000:0.0:1787614194.889544:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269440 00000100:00100000:0.0:1787614194.889597:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787614194.889606:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614194.890307:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e45540600 going to sleep for 11 seconds 00000100:00100000:0.0:1787614194.892715:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269440:12345-0@lo:502:mount.lustre.0 Request processed in 3107us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614194.892724:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787614194.893042:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614194.893295:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787614194.893328:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787614194.893365:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614194.893418:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.893452:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e602f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787614194.893567:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269568 00000100:00100000:0.0:1787614194.893574:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269568 00000100:00100000:0.0:1787614194.893616:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787614194.893625:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614194.893709:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692269568:12345-0@lo:502:mount.lustre.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614194.893715:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787614194.893782:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692269568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614194.893824:0:24158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787614194.893832:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787614194.895691:0:24183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787614194.895709:0:24183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8b5e6df93370) 00000020:00000080:2.0:1787614194.895731:0:24183:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787614194.895814:0:24183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5d4322b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787614194.895818:0:24183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d4322b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787614194.895820:0:24183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d4322b000 3 00010000:00080000:2.0:1787614194.895848:0:24183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5d423ff000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1787614194.907735:0:24183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787614194.908033:0:24183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787614194.908078:0:24183:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787614194.908092:0:24183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9719586bc2ef09c5 00000100:00080000:2.0:1787614194.908102:0:24183:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787614194.908108:0:24183:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b5d423ff000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614194.908142:0:24183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48471c00 x1874448692269696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787614194.908205:0:24183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787614194.908268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.908272:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614194.908280:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.908283:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614194.908307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.908310:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614194.908312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.908315:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787614194.908349:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692269824:0@lo:400:kworker.0 00000100:00100000:2.0:1787614194.908408:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.908441:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787614194.908446:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692269952:0@lo:400:kworker.0 00000100:00100000:2.0:1787614194.908482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.908514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692270208:0@lo:400:kworker.0 00000100:00100000:2.0:1787614194.908540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.908558:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787614194.908563:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692270080:0@lo:400:kworker.0 00000100:00100000:2.0:1787614194.908587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614194.908967:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269824 00000100:00100000:3.0:1787614194.908975:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269824 00000100:00100000:3.0:1787614194.909012:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270080 00000100:00100000:3.0:1787614194.909014:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270080 00000100:00100000:3.0:1787614194.909028:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787614194.909035:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692269824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614194.909097:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692269824:12345-0@lo:400:kworker.0 Request processed in 63us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.909104:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787614194.909119:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787614194.909124:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692270080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614194.909152:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692270080:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.909189:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787614194.909209:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269952 00000100:00100000:3.0:1787614194.909212:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269952 00000100:00100000:3.0:1787614194.909230:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270208 00000100:00100000:3.0:1787614194.909232:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270208 00000100:00100000:3.0:1787614194.909241:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787614194.909246:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692269952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614194.909276:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692269952:12345-0@lo:400:kworker.0 Request processed in 30us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.909282:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787614194.909291:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787614194.909296:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692270208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614194.909318:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692270208:12345-0@lo:400:kworker.0 Request processed in 22us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.909323:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787614194.909363:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692270080:0@lo:400:kworker.0 00010000:00080000:3.0:1787614194.909374:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e48470a80 x1874448692270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614194.909382:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692270208:0@lo:400:kworker.0 00010000:00080000:3.0:1787614194.909405:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e48471f80 x1874448692269952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614194.909412:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692269952:0@lo:400:kworker.0 00000100:00100000:3.0:1787614194.909420:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692269824:0@lo:400:kworker.0 00000100:00100000:0.0:1787614194.910826:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1874448692269696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787614194.910887:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.913730:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692269696 00000100:00100000:2.0:1787614194.913745:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692269696 00000100:00100000:2.0:1787614194.913800:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787614194.913809:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1874448692269696:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787614194.913836:0:22657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1787614194.913901:0:22657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9719586bc2ef09cc 00000004:00100000:2.0:1787614194.913917:0:22657:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787614194.913961:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8b5d423f8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614194.914050:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874448692269696:12345-0@lo:38:llog_process_th.0 Request processed in 240us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614194.914057:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787614194.914108:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e48471c00 x1874448692269696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787614204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614194.914118:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787614194.914126:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787614194.914133:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787614194.914138:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787614194.914140:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d423ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787614194.914145:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1874448692269696:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787614194.914276:0:24183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787614194.914292:0:24183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8b5e6df94d28) 00000020:00000080:2.0:1787614194.914312:0:24183:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787614194.914388:0:24183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5d4322b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787614194.914393:0:24183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d4322b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787614194.914395:0:24183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d4322b000 3 00010000:00080000:2.0:1787614194.914418:0:24183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5d423fb000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.155@tcp at head 00010000:00010000:2.0:1787614194.920079:0:24183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787614194.930033:0:24183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787614194.930084:0:24183:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787614194.930098:0:24183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9719586bc2ef09da 00000100:00080000:2.0:1787614194.930109:0:24183:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787614194.930115:0:24183:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8b5d423fb000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614194.930151:0:24183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48471c00 x1874448692270336/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787614194.930213:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1874448692270336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787614194.930310:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787614194.930372:0:24183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787614194.930398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.930403:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614194.930406:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.930409:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614194.930412:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.930414:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614194.930417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614194.930419:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787614194.930768:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270336 00000100:00100000:3.0:1787614194.930781:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270336 00000100:00100000:3.0:1787614194.930815:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787614194.930824:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692270336:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787614194.930849:0:22655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:3.0:1787614194.930887:0:22655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9719586bc2ef09e1 00000004:00100000:3.0:1787614194.930902:0:22655:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787614194.930932:0:22655:0:(import.c:65:import_set_state_nolock()) ffff8b5e7f661000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787614194.931014:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874448692270336:12345-0@lo:38:llog_process_th.0 Request processed in 189us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.931022:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787614194.931071:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5e48471c00 x1874448692270336/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787614204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614194.931081:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787614194.931089:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787614194.931096:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787614194.931100:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787614194.931102:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d423fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787614194.931107:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1874448692270336:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787614194.932655:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787614194.932716:0:24158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787614194.932743:0:24158:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787614194.932761:0:24158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09b7 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.932772:0:24158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f1200/0x9719586bc2ef09b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09b7 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787614194.932827:0:24158:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787614194.932829:0:24158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787614194.932831:0:24158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614194.932832:0:24158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614194.932833:0:24158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614194.932835:0:24158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614194.932836:0:24158:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614194.932838:0:24158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614194.932844:0:24158:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787614194.932848:0:24158:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787614194.932850:0:24158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787614194.932851:0:24158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787614194.932852:0:24158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614194.932853:0:24158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614194.932854:0:24158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614194.932855:0:24158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614194.932856:0:24158:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614194.932857:0:24158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614194.932857:0:24158:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787614194.932879:0:24158:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787614194.932898:0:24158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692270464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787614194.932971:0:24158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.933007:0:24158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e602f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614194.933033:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270464 00000100:00100000:2.0:1787614194.933040:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270464 00000100:00100000:2.0:1787614194.933077:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787614194.933085:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692270464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787614194.933109:0:22648:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787614194.933121:0:22648:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787614194.954648:0:22648:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787614194.954699:0:22648:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787614194.956188:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24158:x1874448692270464:12345-0@lo:253:mount.lustre.0 Request processed in 23095us (23208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614194.956201:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787614194.956222:0:24158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24158:1874448692270464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787614194.956237:0:24158:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787614194.956241:0:24158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787614194.956242:0:24158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787614194.956244:0:24158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614194.956245:0:24158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614194.956246:0:24158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614194.956247:0:24158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614194.956249:0:24158:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614194.956251:0:24158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614194.956252:0:24158:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787614194.956268:0:24158:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787614194.959816:0:22671:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787614194.959823:0:22671:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787614194.961311:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614194.961334:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef092b expref: 20 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614194.961342:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614194.961349:0:22671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614194.961394:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614194.961410:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 20 pid: 22650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614194.961423:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692270592:0@lo:104: 00000100:00100000:0.0:1787614194.961572:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787614194.961627:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef092b expref: 20 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614194.961649:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef092b expref: 20 pid: 22648 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614194.961658:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692270720:0@lo:104: 00000100:00100000:0.0:1787614194.961685:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614194.961701:0:22671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76030e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787614194.965718:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787614194.965759:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270592 00000100:00100000:2.0:1787614194.965769:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270592 00000100:00100000:2.0:1787614194.965810:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270720 00000100:00100000:2.0:1787614194.965814:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270720 00000100:00100000:2.0:1787614194.965832:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614194.965842:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:22671:x1874448692270592:12345-0@lo:104: 00010000:00010000:2.0:1787614194.965922:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966024:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787614194.966031:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:22671:x1874448692270592:12345-0@lo:104: Request processed in 191us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614194.966038:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614194.966055:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787614194.966062:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4215c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692270720:12345-0@lo:104: 00010000:00010000:2.0:1787614194.966069:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966102:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787614194.966107:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4215c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692270720:12345-0@lo:104: Request processed in 46us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614194.966112:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787614194.966190:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787614194.966197:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966205:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41669200 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614194.966209:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966228:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614194.966235:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614194.966240:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787614194.966274:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966281:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614194.966299:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966305:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e41669200/0x9719586bc2ef0939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0940 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966315:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614194.966318:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966324:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41668800 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614194.966327:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966332:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614194.966338:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614194.966347:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787614194.966359:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966364:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614194.966369:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966375:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e41668800/0x9719586bc2ef092b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0932 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.966386:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614194.966387:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614194.966389:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614194.966395:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614194.966414:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692270848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614194.966447:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.966472:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787614194.966477:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692270976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614194.966495:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614194.967747:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270848 00000100:00100000:2.0:1787614194.967757:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270848 00010000:00010000:2.0:1787614194.967788:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 21 pid: 22650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614194.967817:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692270976 00000100:00100000:2.0:1787614194.967819:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692270976 00010000:00010000:2.0:1787614194.967828:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef092b expref: 22 pid: 22648 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614194.967858:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614194.967997:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:3635:x1874448692270848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614194.968009:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614194.968015:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 22 pid: 22650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968025:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 22 pid: 22650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968042:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614194.968094:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:3635:x1874448692270848:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614194.968100:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614194.968115:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787614194.968120:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3635:x1874448692270976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614194.968127:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614194.968131:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef092b expref: 21 pid: 22648 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968138:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef092b expref: 21 pid: 22648 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968148:0:22641:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968172:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787614194.968196:0:22641:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008373814s 00010000:00010000:2.0:1787614194.968201:0:22641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968208:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968214:0:22641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968221:0:22641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968227:0:22641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e40031400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614194.968231:0:22641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968239:0:22641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968247:0:22641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968256:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614194.968279:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3635:x1874448692270976:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614194.968285:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787614194.968356:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692270976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614194.968365:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692270848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614194.968407:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0a00/0x9719586bc2ef0940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef0939 expref: 20 pid: 22650 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614194.968422:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692270592:0@lo:104: 00010000:00010000:2.0:1787614194.968432:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef092b expref: 19 pid: 22648 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614194.968439:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692270720:0@lo:104: 00010000:00010000:2.0:1787614194.968451:0:22671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968460:0:22671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968466:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614194.968472:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e40031400/0x9719586bc2ef09e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787614194.970382:0:24158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787614194.975232:0:24158:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787614194.975242:0:24158:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787614194.975494:0:24158:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787614194.975551:0:24158:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787614194.975600:0:24158:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787614194.975635:0:24158:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787614194.976283:0:24158:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787614194.976479:0:24158:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787614195.505538:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692271104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614195.505616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614195.505776:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271104 00000100:00100000:1.0:1787614195.505785:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271104 00000100:00100000:1.0:1787614195.505836:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787614195.505845:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692271104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787614195.505890:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787614195.505939:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692271104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614195.505956:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787614195.506000:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692271104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614195.506699:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692271232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787614195.506738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614195.506821:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271232 00000100:00100000:2.0:1787614195.506827:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271232 00000100:00100000:2.0:1787614195.506872:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787614195.506880:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692271232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787614195.506919:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787614195.506970:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692271232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614195.506976:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787614195.507008:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692271232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787614195.569417:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787614196.076131:0:24238:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787614196.079416:0:24238:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787614196.402640:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787614196.402648:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e51a93800 from 13 10000000:01000000:2.0:1787614196.402654:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787614196.402708:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.402721:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.402732:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614196.402770:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787614196.402834:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614196.402879:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6e3d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614196.403177:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271360 00000100:00100000:2.0:1787614196.403185:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271360 00000100:00100000:2.0:1787614196.403237:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787614196.403247:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+19:22652:x1874448692271360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614196.403260:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614196.403289:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef09ef expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403313:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 20 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403324:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 20 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403333:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7af98800, rc 0) 00000100:00100000:2.0:1787614196.403379:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:22652:x1874448692271360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614196.403386:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787614196.403435:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614196.403448:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403457:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614196.403520:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787614196.403551:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614196.403567:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6e3d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614196.403588:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271488 00000100:00100000:2.0:1787614196.403592:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271488 00000100:00100000:2.0:1787614196.403615:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787614196.403621:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:22652:x1874448692271488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787614196.403633:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787614196.403652:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787614196.403655:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787614196.403725:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:22652:x1874448692271488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614196.403732:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787614196.403777:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787614196.403827:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787614196.403834:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403841:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614196.403850:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787614196.403852:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e7af67800 from 13 10000000:01000000:2.0:1787614196.403854:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787614196.403871:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403878:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.403886:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614196.403898:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787614196.403949:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614196.403966:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6e3d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614196.403979:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271616 00000100:00100000:2.0:1787614196.403989:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271616 00000100:00100000:2.0:1787614196.404014:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787614196.404021:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:22652:x1874448692271616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614196.404029:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614196.404038:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef09fd expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.404053:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.404061:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.404067:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7af99400, rc 0) 00000100:00100000:2.0:1787614196.404100:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692271616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614196.404106:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787614196.404132:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614196.404142:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.404150:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614196.404203:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787614196.404233:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614196.404249:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6e3d9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787614196.404410:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271744 00000100:00100000:0.0:1787614196.404415:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271744 00000100:00100000:0.0:1787614196.404448:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787614196.404455:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692271744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787614196.404467:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787614196.404481:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787614196.404484:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787614196.404555:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692271744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614196.404563:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787614196.404593:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692271744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787614196.404639:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787614196.404645:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614196.404658:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614196.604150:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787614197.106880:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787614197.618538:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614198.645904:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614199.665324:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787614200.114043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614200.114049:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787614200.114052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614200.114055:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787614200.114081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614200.114084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787614200.114087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787614200.114090:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787614200.114126:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692272128:0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.114209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614200.114279:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692272640:0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.114306:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614200.114328:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787614200.114333:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692272256:0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.114356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614200.114396:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272128 00000100:00100000:1.0:1787614200.114405:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272128 00000100:00100000:1.0:1787614200.114442:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272640 00000100:00100000:1.0:1787614200.114444:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272640 00000100:00100000:1.0:1787614200.114478:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787614200.114486:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692272128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.114534:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692272128:12345-0@lo:400:kworker.0 Request processed in 48us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614200.114541:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787614200.114558:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787614200.114565:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692272640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.114591:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692272640:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614200.114596:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787614200.114615:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272256 00000100:00100000:1.0:1787614200.114618:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272256 00000100:00100000:1.0:1787614200.114639:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787614200.114644:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692272256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.114672:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692272256:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614200.114678:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787614200.114711:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692272256:0@lo:400:kworker.0 00010000:00080000:1.0:1787614200.114734:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e7614bb80 x1874448692272128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614200.114744:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692272128:0@lo:400:kworker.0 00010000:00080000:1.0:1787614200.114753:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e76149c00 x1874448692272640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614200.114761:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692272640:0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.114986:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692272000:0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614200.115146:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1874448692272512:0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115192:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614200.115212:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787614200.115219:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692271872:0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115243:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614200.115265:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692272384:0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614200.115304:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272512 00000100:00100000:3.0:1787614200.115308:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272512 00000100:00100000:3.0:1787614200.115331:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272384 00000100:00100000:3.0:1787614200.115334:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272384 00000100:00100000:3.0:1787614200.115348:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787614200.115354:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874448692272512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115391:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874448692272512:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614200.115397:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787614200.115410:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787614200.115415:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692272384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115441:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692272384:12345-0@lo:400:kworker.0 Request processed in 26us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614200.115447:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787614200.115466:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692271872 00000100:00100000:3.0:1787614200.115470:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692271872 00000100:00100000:3.0:1787614200.115491:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787614200.115497:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3636:x1874448692271872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.115534:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3636:x1874448692271872:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614200.115540:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787614200.115577:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692271872:0@lo:400:kworker.0 00010000:00080000:3.0:1787614200.115587:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e7614b480 x1874448692272384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614200.115597:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692272384:0@lo:400:kworker.0 00010000:00080000:3.0:1787614200.115606:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e76149500 x1874448692272512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614200.115614:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1874448692272512:0@lo:400:kworker.0 00000100:00080000:3.0:1787614200.115660:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787614200.115664:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787614200.115797:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272000 00000100:00100000:1.0:1787614200.115802:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272000 00000100:00100000:1.0:1787614200.115836:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787614200.115842:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692272000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614200.115875:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692272000:12345-0@lo:400:kworker.0 Request processed in 34us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614200.115881:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787614200.116475:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692272000:0@lo:400:kworker.0 00000100:00100000:3.0:1787614200.626281:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787614200.626305:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692272768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614200.626382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614200.626441:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272768 00000100:00100000:3.0:1787614200.626448:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272768 00000100:00100000:3.0:1787614200.626494:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787614200.626503:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692272768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787614200.626535:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787614200.626581:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692272768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614200.626587:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787614200.626645:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692272768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614200.628746:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787614200.628766:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692272896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614200.628836:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614200.628885:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692272896 00000100:00100000:3.0:1787614200.628892:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692272896 00000100:00100000:3.0:1787614200.628943:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787614200.628954:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692272896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787614200.628987:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787614200.629044:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692272896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614200.629052:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787614200.629097:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692272896:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787614200.689252:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787614201.223243:0:24528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787614201.713478:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787614202.330330:0:24582:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787614202.330632:0:24582:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1787614202.561962:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787614202.743803:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787614203.328332:0:24632:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787614203.329057:0:24632:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787614203.763601:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614204.145242:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614189/real 1787614189] req@ffff8b5e777f5180 x1874448692265984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614204.145280:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e777f5180 x1874448692265984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614204 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614204.145296:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614189/real 1787614189] req@ffff8b5e777f4700 x1874448692266112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614204.145309:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e777f4700 x1874448692266112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614204 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787614204.145336:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e454fd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787614204.145378:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787614204.145384:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692265984:0@lo:8:kworker.0 00000100:00080000:2.0:1787614204.145390:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787614204.145397:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787614204.145400:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692266112:0@lo:8:kworker.0 00000100:00080000:0.0:1787614204.145506:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614204.145511:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614204.145514:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614204.145517:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614204.145535:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614204.145538:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787614204.145541:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e454fd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614204.145548:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1787614204.145553:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787614204.145562:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8b5e454fd800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614204.145571:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692273024:0@lo:400:kworker.0 00000100:00100000:0.0:1787614204.145585:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c4700 x1874448692273536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614204.145601:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614204.145605:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787614204.145619:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614204.145623:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1787614204.145626:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787614204.145631:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8b5e48565800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614204.145646:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c6300 x1874448692273664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787614204.145654:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692273152:0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.145662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614204.145884:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874448692273280:0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.149343:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692273792:0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.149914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614204.149971:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787614204.149979:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692273408:0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.150032:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614204.150851:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273024 00000100:00100000:2.0:1787614204.150866:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273024 00000100:00100000:2.0:1787614204.150953:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787614204.150966:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3636:x1874448692273024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.151069:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3636:x1874448692273024:12345-0@lo:400:kworker.0 Request processed in 105us (5410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614204.151078:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787614204.151840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614204.152121:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1874448692273920:0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.152195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614204.152288:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273792 00000100:00100000:2.0:1787614204.152298:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273792 00000100:00100000:2.0:1787614204.152345:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273920 00000100:00100000:2.0:1787614204.152349:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273920 00000100:00100000:1.0:1787614204.152362:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273408 00000100:00100000:1.0:1787614204.152368:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273408 00000100:00100000:2.0:1787614204.152385:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787614204.152398:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692273792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.152404:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273152 00000100:00100000:1.0:1787614204.152408:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273152 00000100:00100000:1.0:1787614204.152423:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787614204.152430:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692273408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.152477:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692273408:12345-0@lo:400:kworker.0 Request processed in 47us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614204.152495:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787614204.152513:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787614204.152519:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692273152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.153149:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692273152:12345-0@lo:400:kworker.0 Request processed in 625us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614204.153260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614204.153291:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1874448692274048:0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.153554:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692273792:12345-0@lo:400:kworker.0 Request processed in 1157us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614204.153563:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787614204.153588:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273280 00000100:00100000:2.0:1787614204.153593:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273280 00000100:00100000:2.0:1787614204.153615:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787614204.153623:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874448692273920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.153656:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874448692273920:12345-0@lo:400:kworker.0 Request processed in 34us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614204.153662:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787614204.153674:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787614204.153679:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874448692273280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.153756:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787614204.153821:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e4835aa00 x1874448692273920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614204.153836:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1874448692273920:0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.153850:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692273152:0@lo:400:kworker.0 00000100:00100000:0.0:1787614204.154454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614204.154527:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874448692273280:12345-0@lo:400:kworker.0 Request processed in 845us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614204.154552:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787614204.154572:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274048 00000100:00100000:2.0:1787614204.154577:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274048 00000100:00100000:2.0:1787614204.154605:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787614204.154613:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874448692274048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614204.154649:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874448692274048:12345-0@lo:400:kworker.0 Request processed in 37us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614204.154655:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787614204.154697:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787614204.155283:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e763c5c00 x1874448692273280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614204.155377:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874448692273280:0@lo:400:kworker.0 00010000:00080000:0.0:1787614204.155395:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48359f80 x1874448692274048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614204.155404:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1874448692274048:0@lo:400:kworker.0 00000100:00080000:2.0:1787614204.155521:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787614204.155544:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692273536:0@lo:8:kworker.0 00000100:00100000:2.0:1787614204.155594:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614204.155642:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692273664:0@lo:8:kworker.0 00000100:00100000:2.0:1787614204.155671:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614204.155718:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273536 00000100:00100000:3.0:1787614204.155727:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273536 00000100:00100000:3.0:1787614204.155752:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692273664 00000100:00100000:3.0:1787614204.155755:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692273664 00000100:00100000:3.0:1787614204.155766:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787614204.155774:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1874448692273536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787614204.155807:0:24164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:3.0:1787614204.155850:0:24164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef0a0b 00002000:00100000:3.0:1787614204.155867:0:24164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8b5e7f666000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787614204.155871:0:24164:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787614204.155875:0:24164:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787614204.156076:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692273408:0@lo:400:kworker.0 00010000:00080000:1.0:1787614204.156093:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48358380 x1874448692273792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614204.156103:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692273792:0@lo:400:kworker.0 00000100:00100000:1.0:1787614204.156116:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692273024:0@lo:400:kworker.0 00002000:00080000:3.0:1787614204.157546:0:24164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787614204.157609:0:24164:0:(import.c:65:import_set_state_nolock()) ffff8b5e7f660000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787614204.157742:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1874448692273536:12345-0@lo:8:kworker.0 Request processed in 1966us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614204.157753:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787614204.157788:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787614204.157798:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1874448692273664:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787614204.157821:0:24164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787614204.158395:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e763c4700 x1874448692273536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787614224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614204.158409:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787614204.158420:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787614204.158431:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787614204.158437:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787614204.158441:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e454fd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787614204.158469:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787614204.158474:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692273536:0@lo:8:kworker.0 00000004:00080000:1.0:1787614204.158577:0:23400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787614204.158607:0:23400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23400:1874448692274304:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787614204.158661:0:23400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614204.158690:0:23400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851d900 going to sleep for 11 seconds 00000004:00080000:1.0:1787614204.158721:0:23399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787614204.158840:0:23399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 701356681115ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787614204.158847:0:23399:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787614204.158895:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787614204.158915:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787614204.159081:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692274176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787614204.159120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614204.159251:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274304 00000100:00100000:1.0:1787614204.159253:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274176 00000100:00100000:2.0:1787614204.159260:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274304 00000100:00100000:1.0:1787614204.159260:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274176 00000100:00100000:1.0:1787614204.159315:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787614204.160151:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787614204.160818:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1874448692274176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787614204.160870:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787614204.160969:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1874448692274176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1645us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614204.160979:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787614204.162058:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787614204.162076:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23400:x1874448692274304:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1787614204.162249:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e7614a680 x1874448692274176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614204.162279:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692274176:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787614204.166172:0:23390:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787614204.186935:0:24657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787614204.186948:0:24657:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787614204.187100:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23400:x1874448692274304:12345-0@lo:7:osp-pre-0-1.0 Request processed in 25016us (28424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614204.187127:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787614204.194772:0:23400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e7614ad80 x1874448692274304/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787614220 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614204.194795:0:23400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23400:1874448692274304:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787614204.194814:0:23400:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787614204.194864:0:23400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23400:1874448692274432:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787614204.194944:0:23400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614204.194989:0:23400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787614204.195180:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1874448692273664:12345-0@lo:8:kworker.0 Request processed in 37379us (39504us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787614204.195193:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787614204.195248:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614204.195254:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787614204.195258:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692273664:0@lo:8:kworker.0 00000100:00100000:3.0:1787614204.195284:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274432 00000100:00100000:3.0:1787614204.195290:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274432 00000100:00100000:3.0:1787614204.199795:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787614204.199813:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23400:x1874448692274432:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787614204.199860:0:24164:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787614204.200015:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23400:x1874448692274432:12345-0@lo:5:osp-pre-0-1.0 Request processed in 204us (5069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614204.200024:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787614204.202473:0:23400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e7614ad80 x1874448692274432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787614220 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614204.202496:0:23400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23400:1874448692274432:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787614204.202518:0:23400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787614204.202611:0:23400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23400:1874448692274560:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787614204.202685:0:23400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614204.202754:0:23400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76309d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787614204.202879:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274560 00000100:00100000:0.0:1787614204.202888:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274560 00000100:00100000:0.0:1787614204.202974:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787614204.202986:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23400:x1874448692274560:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787614204.203040:0:24657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1787614204.250982:0:24159:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787614204.251005:0:24159:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787614204.252539:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23400:x1874448692274560:12345-0@lo:5:osp-pre-0-1.0 Request processed in 49545us (49843us total) trans 12884901889 rc 0/0 00010000:00080000:3.0:1787614204.252661:0:23400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d43b86300 x1874448692274560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787614220 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614204.252678:0:23400:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787614204.252687:0:23400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23400:1874448692274560:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787614204.252707:0:23400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1787614204.252745:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787614204.252786:0:23400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23400:1874448692274688:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787614204.252834:0:23400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614204.252871:0:23400:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76309d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787614204.252936:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274688 00000100:00100000:1.0:1787614204.252944:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274688 00000100:00100000:1.0:1787614204.252999:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787614204.253019:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23400:x1874448692274688:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787614204.253082:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23400:x1874448692274688:12345-0@lo:900:osp-pre-0-1.0 Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614204.253096:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787614204.253120:0:23400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d43b86300 x1874448692274688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787614220 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614204.253131:0:23400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23400:1874448692274688:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787614204.785288:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614205.748788:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787614205.748810:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692274816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614205.748877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614205.750792:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692274944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614205.750850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614205.750913:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274816 00000100:00100000:3.0:1787614205.750921:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274816 00000100:00100000:3.0:1787614205.750963:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692274944 00000100:00100000:3.0:1787614205.750966:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692274944 00000100:00100000:3.0:1787614205.750982:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787614205.750990:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692274816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787614205.751034:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787614205.751082:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692274816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614205.751089:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787614205.751106:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787614205.751113:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692274944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787614205.751144:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787614205.751199:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692274944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614205.751205:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787614205.751250:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692274944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614205.751284:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692274816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787614205.816368:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614206.840086:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787614207.352950:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787614207.857389:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614208.891914:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787614209.329811:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614209.329817:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614209.329821:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614209.329824:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787614209.329859:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787614209.329863:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787614209.329866:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787614209.329884:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 701 00000100:00080000:2.0:1787614209.329889:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787614209.329896:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8b5e48565800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:2.0:1787614209.329932:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5d43369500 x1874448692275712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787614209.330074:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692275072:0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330137:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692275200:0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.330146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614209.330207:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614209.330228:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692275584:0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330246:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692275840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787614209.330261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614209.330278:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614209.330294:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614209.330303:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692275456:0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330307:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787614209.330315:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692275328:0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.330334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614209.330346:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614209.330376:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275072 00000100:00100000:1.0:1787614209.330383:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275072 00000100:00100000:3.0:1787614209.330387:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275200 00000100:00100000:3.0:1787614209.330393:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275200 00000100:00100000:3.0:1787614209.330436:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275456 00000100:00100000:3.0:1787614209.330439:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275456 00000100:00100000:3.0:1787614209.330454:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787614209.330461:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692275200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330514:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692275200:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614209.330521:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787614209.330536:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787614209.330541:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692275456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330569:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692275456:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614209.330574:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787614209.330605:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692275200:0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330625:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692275456:0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330653:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275328 00000100:00100000:3.0:1787614209.330656:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275328 00000100:00100000:3.0:1787614209.330680:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787614209.330686:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692275328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614209.330719:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692275328:12345-0@lo:400:kworker.0 Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614209.330725:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787614209.330749:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48471f80 x1874448692275328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614209.330760:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692275328:0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.331575:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787614209.331652:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3638:x1874448692275072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.331711:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3638:x1874448692275072:12345-0@lo:400:kworker.0 Request processed in 128us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614209.331719:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787614209.331759:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275584 00000100:00100000:1.0:1787614209.331766:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275584 00000100:00100000:1.0:1787614209.331805:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787614209.332132:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692275584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.332188:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692275584:12345-0@lo:400:kworker.0 Request processed in 377us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614209.332195:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787614209.332237:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692275072:0@lo:400:kworker.0 00010000:00080000:1.0:1787614209.332251:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d43369880 x1874448692275584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787614225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614209.332274:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692275584:0@lo:400:kworker.0 00000100:00080000:1.0:1787614209.332314:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787614209.333365:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1874448692276096:0@lo:400:kworker.0 00000100:00100000:2.0:1787614209.333414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614209.333522:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787614209.333529:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692276224:0@lo:400:kworker.0 00000100:00100000:2.0:1787614209.333555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614209.333584:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276096 00000100:00100000:2.0:1787614209.333591:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276096 00000100:00100000:2.0:1787614209.333633:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276224 00000100:00100000:2.0:1787614209.333636:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276224 00000100:00100000:2.0:1787614209.333655:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787614209.333662:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874448692276096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.333689:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692275968:0@lo:400:kworker.0 00000100:00100000:1.0:1787614209.333717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614209.333786:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874448692276096:12345-0@lo:400:kworker.0 Request processed in 122us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614209.333793:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787614209.333808:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275968 00000100:00100000:2.0:1787614209.333811:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275968 00000100:00100000:2.0:1787614209.333825:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787614209.333831:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692276224:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787614209.333939:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d43368e00 x1874448692276096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614209.333952:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1874448692276096:0@lo:400:kworker.0 00000100:00100000:0.0:1787614209.333989:0:22657:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787614209.333998:0:22657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787614209.334033:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275840 00000100:00100000:0.0:1787614209.334037:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275840 00000100:00100000:0.0:1787614209.334063:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787614209.334071:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692275840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787614209.334093:0:24167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787614209.334128:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692275840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (3851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614209.334134:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787614209.334155:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787614209.334175:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7614a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692275968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614209.334255:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692276224:12345-0@lo:400:kworker.0 Request processed in 421us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614209.334264:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787614209.334304:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d4336a680 x1874448692276224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614209.334315:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692276224:0@lo:400:kworker.0 00000100:00080000:2.0:1787614209.334348:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787614209.334352:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787614209.334381:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d43b86300 x1874448692275840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787614225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614209.334395:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692275840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787614209.334795:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7614a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692275968:12345-0@lo:400:kworker.0 Request processed in 620us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614209.334803:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787614209.334828:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692275712:0@lo:8:kworker.0 00000100:00100000:0.0:1787614209.335574:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787614209.335774:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5d4336bb80 x1874448692275968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614209.335788:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692275968:0@lo:400:kworker.0 00000100:00100000:2.0:1787614209.337801:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692275712 00000100:00100000:2.0:1787614209.337813:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692275712 00000100:00100000:2.0:1787614209.337878:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614209.337887:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1874448692275712:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787614209.337908:0:24164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787614209.339291:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1874448692275712:12345-0@lo:8:kworker.0 Request processed in 1398us (3713us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787614209.339303:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787614209.345569:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614209.345599:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787614209.345605:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692275712:0@lo:8:kworker.0 00010000:00010000:2.0:1787614209.907658:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787614210.000977:0:24979:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787614210.000981:0:24979:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787614210.000982:0:24979:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787614210.001093:0:24979:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b5d423f9800 00000020:01000004:2.0:1787614210.001107:0:24979:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787614210.001122:0:24979:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787614210.001134:0:24979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8b5e6df919b8) 00000020:00000080:2.0:1787614210.001150:0:24979:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787614210.064073:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787614210.064893:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787614210.065087:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787614210.065337:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787614210.065910:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787614210.066110:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787614210.066487:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787614210.069481:0:24979:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787614210.070004:0:24979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787614210.070019:0:24979:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787614210.070031:0:24979:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9719586bc2ef0a19 00000020:01000004:2.0:1787614210.070038:0:24979:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787614210.070058:0:24979:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787614210.070062:0:24979:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787614210.070067:0:24979:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787614210.070095:0:24979:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787614210.070099:0:24979:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787614210.084919:0:24979:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787614210.084960:0:24979:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.155@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787614210.084965:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787614210.084967:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787614210.084968:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614210.084969:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614210.084970:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614210.084971:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614210.084973:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787614210.084975:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614210.084976:0:24979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787614210.084980:0:24979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787614210.084982:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787614210.084983:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787614210.084985:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614210.084986:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614210.084987:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614210.084988:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614210.084989:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787614210.084990:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614210.084991:0:24979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787614210.085023:0:24979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787614210.085043:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276352:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787614210.085108:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.085190:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.085482:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276352 00000100:00100000:2.0:1787614210.085490:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276352 00000100:00100000:2.0:1787614210.085542:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787614210.085551:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24979:x1874448692276352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787614210.085587:0:22648:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787614210.085590:0:22648:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787614210.085593:0:22648:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787614210.085977:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24979:x1874448692276352:12345-0@lo:253:mount.lustre.0 Request processed in 425us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.085986:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787614210.086082:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276352:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787614210.086093:0:24979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787614210.086095:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787614210.086097:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787614210.086098:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787614210.086099:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787614210.086100:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787614210.086107:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787614210.086109:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787614210.086110:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787614210.086111:0:24979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787614210.086127:0:24979:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5d423f9800 from lustre-OST0001 10000000:01000000:3.0:1787614210.086153:0:24979:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787614210.086156:0:24979:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787614210.086197:0:24979:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b5e7afb19b8 local copy 00010000:00010000:3.0:1787614210.086208:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614210.086291:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614210.086323:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.086368:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.086508:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276480 00000100:00100000:2.0:1787614210.086513:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276480 00000100:00100000:2.0:1787614210.086552:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787614210.086560:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24979:x1874448692276480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614210.086646:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24979:x1874448692276480:12345-0@lo:501:mount.lustre.0 Request processed in 76us (312us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787614210.086654:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787614210.086828:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b84000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787614210.086843:0:24979:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787614210.086863:0:24979:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787614210.086880:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.086890:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99a00/0x9719586bc2ef0733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef073a expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614210.086925:0:24979:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5d423f9800 10000000:01000000:0.0:1787614210.086931:0:24979:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787614210.086936:0:24979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787614210.086938:0:24979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787614210.086942:0:24979:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787614210.086945:0:24979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787614210.086968:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.086976:0:24979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.086985:0:24979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614210.086998:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787614210.087030:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614210.087042:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e70a28a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.087106:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276608 00000100:00100000:2.0:1787614210.087111:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276608 00000100:00100000:2.0:1787614210.087130:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787614210.087136:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:24979:x1874448692276608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614210.087144:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614210.087184:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7af99c00/0x9719586bc2ef0a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0a20 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.087205:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7af99c00/0x9719586bc2ef0a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0a20 expref: 22 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.087214:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7af99c00/0x9719586bc2ef0a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0a20 expref: 22 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.087223:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7af99c00, rc 0) 00000100:00100000:2.0:1787614210.087259:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276608:12345-0@lo:101:mount.lustre.0 Request processed in 124us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.087265:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787614210.087544:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787614210.087557:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a27 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.087567:0:24979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0a27 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787614210.088593:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787614210.090033:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787614210.092823:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787614210.092893:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787614210.092912:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787614210.092926:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787614210.092940:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787614210.092951:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787614210.092965:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787614210.092978:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787614210.092995:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787614210.093039:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787614210.093047:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787614210.093601:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614210.093788:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614210.093880:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.095494:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276736 00000100:00100000:2.0:1787614210.095506:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276736 00000100:00100000:2.0:1787614210.095624:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787614210.095644:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614210.095839:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276736:12345-0@lo:501:mount.lustre.0 Request processed in 197us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.095848:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787614210.095951:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614210.096001:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614210.096052:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.096663:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787614210.096830:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276864 00000100:00100000:1.0:1787614210.096836:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276864 00000100:00100000:1.0:1787614210.096880:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787614210.096889:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276864:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614210.097621:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276864:12345-0@lo:503:mount.lustre.0 Request processed in 732us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.097637:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787614210.097844:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787614210.098555:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787614210.098744:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614210.098801:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614210.098836:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787614210.098893:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692276992 00000100:00100000:3.0:1787614210.098899:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692276992 00000100:00100000:3.0:1787614210.098971:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787614210.098980:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614210.099794:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692276992:12345-0@lo:502:mount.lustre.0 Request processed in 812us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.099803:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787614210.100020:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692276992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787614210.100319:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787614210.100349:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787614210.100365:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787614210.100378:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787614210.100463:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787614210.100481:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787614210.100493:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787614210.100506:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787614210.100517:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787614210.100546:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787614210.100593:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614210.100801:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e70a28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787614210.100890:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277120 00000100:00100000:3.0:1787614210.100896:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277120 00000100:00100000:3.0:1787614210.100935:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787614210.100942:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692277120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614210.101034:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692277120:12345-0@lo:502:mount.lustre.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.101042:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787614210.101190:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787614210.101249:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787614210.101259:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787614210.102405:0:24983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787614210.102414:0:24983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787614210.102420:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787614210.102423:0:24983:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787614210.102428:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787614210.102442:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8b5e44410000) 00000020:00000080:0.0:1787614210.102466:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787614210.102470:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787614210.102531:0:24983:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5d423f9800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787614210.102538:0:24983:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787614210.102557:0:24983:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9719586bc2ef0a35 00010000:00010000:1.0:1787614210.107989:0:24983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787614210.109756:0:24983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1787614210.111565:0:24983:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787614210.112991:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787614210.113001:0:24983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.113018:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.113021:0:24983:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787614210.113025:0:24983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614210.113029:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.113030:0:24983:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787614210.113033:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787614210.113035:0:24983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787614210.113037:0:24983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.113039:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.113040:0:24983:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787614210.113042:0:24983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614210.113044:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.113045:0:24983:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787614210.113048:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787614210.113075:0:24983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.113078:0:24983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.113079:0:24983:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787614210.113083:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1787614210.113330:0:24979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787614210.113360:0:24979:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787614210.113385:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a27 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.113492:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e40031400/0x9719586bc2ef0a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a27 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614210.113500:0:24979:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5d423f9800 from 1 10000000:01000000:2.0:1787614210.113503:0:24979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787614210.113534:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.113540:0:24979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.113550:0:24979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.113569:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787614210.113627:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.113656:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e457539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614210.115904:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277248 00000100:00100000:3.0:1787614210.115917:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277248 00000100:00100000:3.0:1787614210.115982:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787614210.115992:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:24979:x1874448692277248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787614210.116007:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614210.116022:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0a3c expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614210.116047:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614210.116058:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614210.116066:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7f6f0000, rc 0) 00000100:00100000:3.0:1787614210.116149:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277248:12345-0@lo:101:mount.lustre.0 Request processed in 159us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.116181:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787614210.116370:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787614210.116400:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.116410:0:24979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787614210.117465:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787614210.117957:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787614210.118150:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787614210.118382:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787614210.118559:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787614210.118573:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787614210.118587:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787614210.118599:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787614210.118610:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787614210.118623:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787614210.118637:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787614210.118651:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787614210.118663:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787614210.118691:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787614210.118696:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787614210.118781:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614210.118842:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.118893:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e45753900 going to sleep for 11 seconds 00000100:00100000:1.0:1787614210.119018:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277376 00000100:00100000:1.0:1787614210.119031:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277376 00000100:00100000:1.0:1787614210.119078:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787614210.119087:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787614210.119213:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277376:12345-0@lo:501:mount.lustre.0 Request processed in 127us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.119221:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787614210.122339:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787614210.122391:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787614210.122620:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.122659:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e45753900 going to sleep for 11 seconds 00000100:00100000:1.0:1787614210.125106:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277504 00000100:00100000:1.0:1787614210.125120:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277504 00000100:00100000:1.0:1787614210.125194:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787614210.125217:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787614210.125361:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277504:12345-0@lo:503:mount.lustre.0 Request processed in 146us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.125369:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787614210.125688:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787614210.126092:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787614210.126302:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614210.126355:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.126394:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277632 00000100:00100000:2.0:1787614210.126400:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277632 00000100:00100000:2.0:1787614210.126432:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787614210.126440:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614210.126520:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277632:12345-0@lo:502:mount.lustre.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.126534:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787614210.126575:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.126590:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614210.126829:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787614210.126854:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787614210.126884:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787614210.126911:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787614210.126923:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787614210.126934:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787614210.126945:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787614210.126957:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787614210.126968:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787614210.126979:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787614210.126991:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787614210.127011:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614210.127046:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.127059:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787614210.127336:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277760 00000100:00100000:1.0:1787614210.127341:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277760 00000100:00100000:1.0:1787614210.127390:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787614210.127398:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787614210.127479:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277760:12345-0@lo:502:mount.lustre.0 Request processed in 81us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.127487:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787614210.128752:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614210.128839:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787614210.128852:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787614210.129716:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614210.129726:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129729:0:24987:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787614210.129734:0:24987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5d423f9800 00000020:00000080:1.0:1787614210.129737:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787614210.129745:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.129747:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129749:0:24987:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787614210.129761:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614210.129763:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129764:0:24987:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787614210.129767:0:24987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5d423f9800 00000020:00000080:1.0:1787614210.129769:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787614210.129826:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.129829:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129830:0:24987:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787614210.129833:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614210.129835:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129836:0:24987:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787614210.129839:0:24987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5d423f9800 00000020:00000080:1.0:1787614210.129841:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787614210.129856:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.129859:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129860:0:24987:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787614210.129862:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787614210.129864:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129875:0:24987:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787614210.129880:0:24987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5d423f9800 00000020:00000080:1.0:1787614210.129882:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787614210.129904:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787614210.129907:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787614210.129908:0:24987:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787614210.129914:0:24987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787614210.131310:0:24979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787614210.131350:0:24979:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787614210.131368:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.131401:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614210.131457:0:24979:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787614210.131460:0:24979:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5d423f9800 10000000:01000000:0.0:1787614210.131463:0:24979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5d423f9800 10000000:01000000:0.0:1787614210.131467:0:24979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787614210.131471:0:24979:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5d423f9800 from 1 10000000:01000000:0.0:1787614210.131474:0:24979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787614210.131507:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.131515:0:24979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.131525:0:24979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614210.131549:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787614210.131621:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614210.131660:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e70a28000 going to sleep for 11 seconds 00000100:00100000:1.0:1787614210.131884:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692277888 00000100:00100000:1.0:1787614210.131892:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692277888 00000100:00100000:1.0:1787614210.131939:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787614210.131949:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:24979:x1874448692277888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787614210.131962:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614210.131973:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e41668800/0x9719586bc2ef0a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0a4a expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614210.132007:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e41668800/0x9719586bc2ef0a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0a4a expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614210.132017:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e41668800/0x9719586bc2ef0a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0a4a expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614210.132025:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e41668800, rc 0) 00000100:00100000:1.0:1787614210.132058:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692277888:12345-0@lo:101:mount.lustre.0 Request processed in 112us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.132064:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787614210.132147:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692277888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787614210.132184:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a51 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614210.132194:0:24979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0a51 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787614210.135807:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787614210.136115:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787614210.141904:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787614210.141946:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787614210.141961:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787614210.141975:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787614210.141987:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787614210.142000:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787614210.142012:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787614210.142024:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787614210.142051:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787614210.142067:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787614210.142080:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787614210.142098:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787614210.142113:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787614210.142127:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787614210.142141:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787614210.142152:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787614210.142186:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787614210.142203:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787614210.142219:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787614210.142235:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787614210.142248:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787614210.142260:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787614210.142277:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787614210.142294:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787614210.142320:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787614210.142350:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787614210.142366:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787614210.142376:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787614210.142387:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787614210.142424:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787614210.142661:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787614210.142686:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787614210.142702:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787614210.142714:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787614210.142727:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787614210.142743:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787614210.142756:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787614210.142772:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787614210.142788:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787614210.142803:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787614210.142832:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787614210.142849:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787614210.142861:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787614210.142887:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787614210.142902:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787614210.142915:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787614210.142928:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787614210.142940:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787614210.143068:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787614210.143089:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787614210.143114:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787614210.143119:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787614210.143268:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787614210.143342:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614210.143388:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e70a283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614210.144836:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278016 00000100:00100000:3.0:1787614210.144848:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278016 00000100:00100000:3.0:1787614210.144913:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787614210.144923:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614210.145091:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278016:12345-0@lo:501:mount.lustre.0 Request processed in 168us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.145106:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787614210.145178:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787614210.145220:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787614210.145261:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.145289:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787614210.145791:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278144 00000100:00100000:0.0:1787614210.145798:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278144 00000100:00100000:0.0:1787614210.145824:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787614210.145831:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787614210.145932:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278144:12345-0@lo:503:mount.lustre.0 Request processed in 101us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614210.145946:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787614210.147000:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278144:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787614210.149585:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787614210.151816:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614210.151918:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.151976:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.152174:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278272 00000100:00100000:2.0:1787614210.152183:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278272 00000100:00100000:2.0:1787614210.152236:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787614210.152245:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614210.152375:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278272:12345-0@lo:502:mount.lustre.0 Request processed in 129us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.152397:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787614210.152581:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787614210.152944:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787614210.152979:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787614210.152994:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787614210.153008:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787614210.153021:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787614210.153032:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787614210.153049:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787614210.153061:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787614210.153076:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787614210.153091:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787614210.153105:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787614210.153115:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787614210.153127:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787614210.153137:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787614210.153148:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787614210.153200:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787614210.153228:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787614210.153240:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787614210.153252:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787614210.153263:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787614210.153272:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787614210.153282:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787614210.153292:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787614210.153303:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787614210.153316:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787614210.153327:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787614210.153336:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787614210.153345:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787614210.153356:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787614210.153367:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787614210.153376:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787614210.155755:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787614210.155830:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787614210.155846:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787614210.155859:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787614210.155883:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787614210.155896:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787614210.155909:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787614210.155921:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787614210.155933:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787614210.155945:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787614210.155957:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787614210.155969:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787614210.155981:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787614210.155992:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787614210.156002:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787614210.156014:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787614210.156027:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787614210.156115:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614210.156212:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.156267:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278400 00000100:00100000:3.0:1787614210.156274:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278400 00000100:00100000:3.0:1787614210.156319:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787614210.156327:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787614210.158741:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278400:12345-0@lo:502:mount.lustre.0 Request processed in 2060us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.158756:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787614210.159209:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.159238:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614210.159513:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787614210.159542:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787614210.159577:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614210.159629:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.160015:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278528 00000100:00100000:2.0:1787614210.160023:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278528 00000100:00100000:2.0:1787614210.160060:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787614210.160068:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787614210.160175:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692278528:12345-0@lo:502:mount.lustre.0 Request processed in 88us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.160182:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787614210.164345:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.164544:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692278528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787614210.164655:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787614210.164748:0:24979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787614210.169630:0:24992:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787614210.169648:0:24992:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b5e7554b370) 00000020:00000080:1.0:1787614210.171038:0:24992:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787614210.171187:0:24992:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5d423f9800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787614210.171192:0:24992:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d423f9800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787614210.171203:0:24992:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d423f9800 3 00010000:00080000:1.0:1787614210.171244:0:24992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5d41e4b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.155@tcp at head 00010000:00010000:1.0:1787614210.174780:0:24992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787614210.175008:0:24992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787614210.175052:0:24992:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787614210.175064:0:24992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9719586bc2ef0a5f 00000100:00080000:1.0:1787614210.175074:0:24992:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787614210.175079:0:24992:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b5d41e4b800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:1.0:1787614210.175112:0:24992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e763c7b80 x1874448692278656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787614210.175140:0:24992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787614210.175341:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614210.175346:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614210.175349:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614210.175352:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787614210.175358:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692278656:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787614210.175386:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614210.175390:0:13196:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787614210.175393:0:13196:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787614210.175398:0:13196:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 706 00000100:00080000:0.0:1787614210.175401:0:13196:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787614210.175406:0:13196:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8b5e48565800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614210.175422:0:13196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48358e00 x1874448692279296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614210.175429:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.175492:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692279296:0@lo:8:kworker.0 00000100:00100000:3.0:1787614210.175523:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.175571:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278656 00000100:00100000:3.0:1787614210.175578:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278656 00000100:00100000:3.0:1787614210.175610:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787614210.175618:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1874448692278656:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787614210.175640:0:22655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:3.0:1787614210.175681:0:22655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9719586bc2ef0a66 00000004:00100000:3.0:1787614210.175700:0:22655:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787614210.175730:0:22655:0:(import.c:65:import_set_state_nolock()) ffff8b5d432af000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787614210.175793:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874448692278656:12345-0@lo:38:llog_process_th.0 Request processed in 174us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.175801:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787614210.175828:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279296 00000100:00100000:3.0:1787614210.175832:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279296 00000100:00100000:3.0:1787614210.175875:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787614210.175880:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1874448692279296:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787614210.175970:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e763c7b80 x1874448692278656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614210.175980:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787614210.175987:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787614210.175993:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787614210.175998:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787614210.176000:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d41e4b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787614210.176006:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1874448692278656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787614210.176618:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692278784:0@lo:400:kworker.0 00000100:00100000:1.0:1787614210.176905:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874448692278912:0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.177028:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1874448692279296:12345-0@lo:8:kworker.0 Request processed in 1145us (1503us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787614210.177037:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787614210.177411:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787614210.177418:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614210.177422:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787614210.177425:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692279296:0@lo:8:kworker.0 00000100:00100000:2.0:1787614210.177587:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.177609:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874448692279424:0@lo:400:kworker.0 00000100:00100000:2.0:1787614210.177632:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.177661:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692279040:0@lo:400:kworker.0 00000100:00100000:2.0:1787614210.177694:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.177719:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692279680:0@lo:400:kworker.0 00000100:00100000:0.0:1787614210.177737:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278784 00000100:00100000:2.0:1787614210.177740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614210.177744:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278784 00000100:00100000:2.0:1787614210.177769:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787614210.177778:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692279168:0@lo:400:kworker.0 00000100:00100000:0.0:1787614210.177791:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279040 00000100:00100000:0.0:1787614210.177795:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279040 00000100:00100000:2.0:1787614210.177803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.181088:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787614210.181115:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692278784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.181266:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692278784:12345-0@lo:400:kworker.0 Request processed in 165us (3680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.181274:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787614210.181296:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787614210.181302:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692279040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.181345:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692279040:12345-0@lo:400:kworker.0 Request processed in 43us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.181351:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787614210.181394:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692278784:0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.181428:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692279040:0@lo:400:kworker.0 00000100:00100000:0.0:1787614210.182233:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279424 00000100:00100000:0.0:1787614210.182242:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279424 00000100:00100000:0.0:1787614210.182344:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279680 00000100:00100000:0.0:1787614210.182348:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279680 00000100:00100000:1.0:1787614210.184851:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614210.194106:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e4835b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1874448692279552:0@lo:400:kworker.0 00000100:00100000:1.0:1787614210.194190:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614210.198128:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692278912 00000100:00100000:3.0:1787614210.198145:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692278912 00000100:00100000:3.0:1787614210.198229:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787614210.198243:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874448692279424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.198376:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874448692279424:12345-0@lo:400:kworker.0 Request processed in 137us (20742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.198384:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787614210.198401:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787614210.198409:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692279680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.198447:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692279680:12345-0@lo:400:kworker.0 Request processed in 40us (20707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.198453:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787614210.198465:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787614210.198471:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874448692278912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614210.198501:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874448692278912:12345-0@lo:400:kworker.0 Request processed in 30us (13658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614210.198507:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787614210.198559:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48359880 x1874448692279680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614210.198577:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692279680:0@lo:400:kworker.0 00010000:00080000:3.0:1787614210.198610:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e4835b480 x1874448692279424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614210.198620:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874448692279424:0@lo:400:kworker.0 00000020:01000004:0.0:1787614210.200837:0:24992:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787614210.200855:0:24992:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8b5e44414d28) 00000020:00000080:0.0:1787614210.200895:0:24992:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787614210.200979:0:24992:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5d423f9800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787614210.200984:0:24992:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5d423f9800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787614210.200986:0:24992:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5d423f9800 3 00010000:00080000:0.0:1787614210.201014:0:24992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5d43a50000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.155@tcp at head 00010000:00010000:0.0:1787614210.202640:0:24992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787614210.202825:0:24992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787614210.202890:0:24992:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787614210.202904:0:24992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9719586bc2ef0a74 00000100:00080000:0.0:1787614210.202913:0:24992:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787614210.202919:0:24992:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8b5d43a50000 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:0.0:1787614210.202957:0:24992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48359c00 x1874448692279808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787614210.202983:0:24992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787614210.203029:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614210.203034:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787614210.203037:0:13196:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787614210.203040:0:13196:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787614210.203044:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1874448692279808:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787614210.203518:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279168 00000100:00100000:2.0:1787614210.203527:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279168 00000100:00100000:2.0:1787614210.203580:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787614210.203590:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692279168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614210.203665:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692279168:12345-0@lo:400:kworker.0 Request processed in 77us (25861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.203682:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787614210.203776:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48358000 x1874448692279168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787614226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614210.203804:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692279168:0@lo:400:kworker.0 00000040:00080000:0.0:1787614210.204341:0:24992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:1.0:1787614210.205420:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279552 00000100:00100000:1.0:1787614210.205430:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279552 00000100:00100000:1.0:1787614210.205476:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787614210.205485:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874448692279552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614210.205540:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874448692279552:12345-0@lo:400:kworker.0 Request processed in 57us (11351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.205547:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787614210.205575:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614210.205634:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279808 00000100:00100000:1.0:1787614210.205638:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279808 00000100:00100000:1.0:1787614210.205661:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787614210.205666:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1874448692279808:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787614210.205689:0:22656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1787614210.205723:0:22656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9719586bc2ef0a7b 00000004:00100000:1.0:1787614210.205739:0:22656:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1787614210.205742:0:24979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00080000:1.0:1787614210.205774:0:22656:0:(import.c:65:import_set_state_nolock()) ffff8b5e7b35f000 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1787614210.205779:0:24979:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787614210.205794:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a51 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.205806:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e40031a00/0x9719586bc2ef0a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0a51 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614210.205819:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874448692279808:12345-0@lo:38:llog_process_th.0 Request processed in 150us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.205827:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:2.0:1787614210.205850:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787614210.205853:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787614210.205855:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614210.205856:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614210.205857:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614210.205859:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614210.205860:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614210.205862:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614210.205864:0:24979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787614210.205879:0:24979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787614210.205881:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787614210.205883:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787614210.205884:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614210.205885:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614210.205892:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614210.205893:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614210.205894:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614210.205895:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614210.205896:0:24979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787614210.205913:0:24979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787614210.205929:0:24979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692279936:0@lo:253:mount.lustre.0 00010000:00080000:1.0:1787614210.205956:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48359c00 x1874448692279808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787614220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614210.205967:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787614210.205975:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00100000:2.0:1787614210.205981:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787614210.205991:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:2.0:1787614210.206013:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692279936 00000100:00100000:2.0:1787614210.206018:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692279936 00000100:00100000:2.0:1787614210.206046:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787614210.206052:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692279936:12345-0@lo:253:mount.lustre.0 00000100:00080000:1.0:1787614210.206064:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787614210.206068:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5d43a50000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 20000000:01000000:2.0:1787614210.206071:0:22650:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1787614210.206076:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1874448692279808:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787614210.206087:0:22650:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787614210.206114:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e4835b800 x1874448692279552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614210.206126:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e4835b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1874448692279552:0@lo:400:kworker.0 00010000:00080000:1.0:1787614210.206151:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5e48359500 x1874448692278912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614210.206197:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874448692278912:0@lo:400:kworker.0 00000100:00100000:2.0:1787614210.206250:0:24979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e43db3c00 going to sleep for 11 seconds 20000000:01000000:0.0:1787614210.219247:0:22650:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787614210.219262:0:22650:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787614210.219524:0:22671:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787614210.219528:0:22671:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787614210.219547:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219563:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219571:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 24 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219578:0:22671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219614:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 24 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219634:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 24 pid: 22650 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.219653:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692280064:0@lo:104: 00000100:00100000:2.0:1787614210.219728:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787614210.219782:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219790:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 24 pid: 22649 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.219798:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d4336a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692280192:0@lo:104: 00000100:00100000:2.0:1787614210.219819:0:22671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.219838:0:22671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787614210.219857:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280064 00000100:00100000:2.0:1787614210.219863:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280064 00000100:00100000:2.0:1787614210.219911:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280192 00000100:00100000:2.0:1787614210.219914:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280192 00000100:00100000:2.0:1787614210.219929:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787614210.219937:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:22671:x1874448692280064:12345-0@lo:104: 00010000:00010000:2.0:1787614210.219949:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.219996:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787614210.220001:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:22671:x1874448692280064:12345-0@lo:104: Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.220008:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787614210.220025:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787614210.220031:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692280192:12345-0@lo:104: 00010000:00010000:2.0:1787614210.220039:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220082:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787614210.220087:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:22671:x1874448692280192:12345-0@lo:104: Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.220094:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787614210.220112:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787614210.220118:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220126:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98000 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614210.220131:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614210.220139:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:24979:x1874448692279936:12345-0@lo:253:mount.lustre.0 Request processed in 14083us (14156us total) trans 0 rc 0/0 00010000:00010000:2.0:1787614210.220141:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614210.220155:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614210.220180:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 10000000:01000000:2.0:1787614210.220181:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787614210.220223:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220230:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614210.220256:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220264:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7af98000/0x9719586bc2ef09fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0a04 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220285:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614210.220288:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220293:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99600 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:2.0:1787614210.220296:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220302:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787614210.220309:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614210.220313:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787614210.220327:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220333:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787614210.220352:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220359:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99600/0x9719586bc2ef09ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef09f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220370:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614210.220371:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614210.220373:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614210.220380:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614210.220392:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787614210.220403:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692280320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614210.220434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.220468:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280320 00000100:00100000:2.0:1787614210.220472:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280320 00010000:00010000:2.0:1787614210.220490:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 24 pid: 22650 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.220510:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787614210.220516:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3637:x1874448692280320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614210.220524:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614210.220529:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 24 pid: 22650 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220537:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 24 pid: 22650 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.220551:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614210.220577:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3637:x1874448692280320:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.220583:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787614210.220634:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692280320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614210.220658:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7af99400/0x9719586bc2ef0a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef09fd expref: 23 pid: 22650 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.220667:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692280064:0@lo:104: 00000100:00100000:2.0:1787614210.220676:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d4336a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22671:1874448692280192:0@lo:104: 00010000:00010000:2.0:1787614210.220691:0:22671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.220728:0:24979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:24979:1874448692279936:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787614210.220737:0:24979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787614210.220741:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787614210.220743:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787614210.220744:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787614210.220745:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787614210.220747:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787614210.220748:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787614210.220749:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787614210.220751:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787614210.220752:0:24979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787614210.220762:0:24979:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787614210.221480:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692280448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787614210.221525:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.223468:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280448 00000100:00100000:2.0:1787614210.223480:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280448 00010000:00010000:2.0:1787614210.223521:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 23 pid: 22649 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614210.223557:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787614210.223566:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:3635:x1874448692280448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787614210.223578:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614210.223583:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 23 pid: 22649 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223594:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 23 pid: 22649 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223610:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7af98800/0x9719586bc2ef09f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef09ef expref: 23 pid: 22649 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223625:0:22641:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223643:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787614210.223659:0:22641:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008373814s 00010000:00010000:2.0:1787614210.223664:0:22641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223686:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223693:0:22641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223699:0:22641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223705:0:22641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614210.223709:0:22641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223717:0:22641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223734:0:22641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223745:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614210.223819:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:3635:x1874448692280448:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.223826:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787614210.223859:0:22671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223877:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614210.223884:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7af98e00/0x9719586bc2ef0a82 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614210.225512:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692280448:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787614210.229748:0:24979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787614210.238123:0:24979:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787614210.238131:0:24979:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787614210.238211:0:24979:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787614210.238259:0:24979:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787614210.238275:0:24979:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787614210.238308:0:24979:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787614210.239385:0:24979:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787614210.239696:0:24979:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787614210.865697:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787614210.865721:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692280576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787614210.865791:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614210.865839:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280576 00000100:00100000:2.0:1787614210.865846:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280576 00000100:00100000:2.0:1787614210.865903:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787614210.865913:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692280576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787614210.865946:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787614210.865995:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692280576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614210.866003:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787614210.866059:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692280576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787614210.866684:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614210.866695:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692280704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787614210.866732:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614210.866760:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280704 00000100:00100000:1.0:1787614210.866765:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280704 00000100:00100000:1.0:1787614210.866800:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787614210.866808:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692280704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787614210.866828:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787614210.866877:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692280704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614210.866885:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787614210.866920:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692280704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787614210.929364:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787614211.088809:0:25046:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787614211.089046:0:25046:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787614211.258113:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614190/real 1787614190] req@ffff8b5e76149180 x1874448692266624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.258141:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e76149180 x1874448692266624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.258154:0:3634:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787614190/real 1787614190] req@ffff8b5e7614aa00 x1874448692266752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.258193:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5e7614aa00 x1874448692266752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787614210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787614211.258211:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614211.258237:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787614211.258241:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692266624:0@lo:8:kworker.0 00000100:00080000:3.0:1787614211.258246:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787614211.258252:0:3634:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787614211.258254:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692266752:0@lo:8:kworker.0 00000100:00080000:3.0:1787614211.258322:0:24546:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614211.258326:0:24546:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787614211.258328:0:24546:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614211.258332:0:24546:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:3.0:1787614211.258344:0:24546:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787614211.258351:0:24546:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b5e4608e800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614211.258370:0:24546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e7614aa00 x1874448692280960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787614211.258381:0:24546:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614211.258384:0:24546:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787614211.258386:0:24546:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614211.258388:0:24546:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:3.0:1787614211.258391:0:24546:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787614211.258394:0:24546:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b5e67931800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614211.258417:0:24546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e76149180 x1874448692281088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787614211.258450:0:24546:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787614211.258453:0:24546:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787614211.258455:0:24546:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787614211.258459:0:24546:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8b5e48565800 using connection 192.168.206.155@tcp/0@lo 00000100:00100000:3.0:1787614211.258470:0:24546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5e48471c00 x1874448692281472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787614211.258532:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692280832:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.258590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.258777:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692281728:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.258802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.258835:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787614211.258841:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692281600:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.258889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.258907:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692282112:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.258927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.258955:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692281216:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.258978:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.258996:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692281856:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.259014:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.259027:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787614211.259031:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692281344:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.259051:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.259069:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1874448692281984:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.259087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614211.259780:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281728 00000100:00100000:1.0:1787614211.259789:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281728 00000100:00100000:1.0:1787614211.259838:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281600 00000100:00100000:1.0:1787614211.259841:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281600 00000100:00100000:1.0:1787614211.259853:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282112 00000100:00100000:1.0:1787614211.259855:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282112 00000100:00100000:1.0:1787614211.259884:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281216 00000100:00100000:1.0:1787614211.259887:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281216 00000100:00100000:1.0:1787614211.259898:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281856 00000100:00100000:1.0:1787614211.259900:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281856 00000100:00100000:1.0:1787614211.259912:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281984 00000100:00100000:1.0:1787614211.259914:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281984 00000100:00100000:1.0:1787614211.259929:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787614211.259937:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692281728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614211.260007:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692281728:12345-0@lo:400:kworker.0 Request processed in 70us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.260014:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787614211.260030:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787614211.260035:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692281600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614211.260058:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692281600:12345-0@lo:400:kworker.0 Request processed in 24us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.260063:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787614211.260074:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787614211.260080:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692282112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614211.260104:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692282112:12345-0@lo:400:kworker.0 Request processed in 25us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.260110:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787614211.260120:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787614211.260125:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692281216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614211.260184:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692281216:12345-0@lo:400:kworker.0 Request processed in 59us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.260190:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787614211.260202:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787614211.260207:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692281856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614211.260233:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692281856:12345-0@lo:400:kworker.0 Request processed in 26us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.260238:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787614211.260249:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787614211.260329:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874448692281984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614211.260363:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874448692281984:12345-0@lo:400:kworker.0 Request processed in 108us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.260369:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787614211.260396:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787614211.260411:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787614211.260449:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e777f4a80 x1874448692281984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614211.260462:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1874448692281984:0@lo:400:kworker.0 00010000:00080000:1.0:1787614211.260631:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e48471500 x1874448692281216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614211.260645:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692281216:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.260726:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280832 00000100:00100000:3.0:1787614211.260732:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280832 00000100:00100000:3.0:1787614211.260769:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787614211.260776:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:3638:x1874448692280832:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787614211.260782:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e777f5180 x1874448692281856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614211.260792:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692281856:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.260811:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:3638:x1874448692280832:12345-0@lo:400:kworker.0 Request processed in 36us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614211.260817:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787614211.260847:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281344 00000100:00100000:3.0:1787614211.260851:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281344 00000100:00100000:3.0:1787614211.260903:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787614211.260910:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692281344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.260947:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692281344:12345-0@lo:400:kworker.0 Request processed in 38us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614211.260963:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787614211.260990:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692280960:0@lo:8:kworker.0 00000100:00100000:3.0:1787614211.261022:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.261052:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692281088:0@lo:8:kworker.0 00000100:00100000:3.0:1787614211.261078:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787614211.261090:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614211.261095:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692281472:0@lo:8:kworker.0 00010000:00080000:1.0:1787614211.261111:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e48471f80 x1874448692281344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.261115:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614211.261121:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692281344:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.261140:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692280960 00000100:00100000:3.0:1787614211.261144:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692280960 00000100:00100000:3.0:1787614211.261184:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281088 00000100:00100000:3.0:1787614211.261188:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281088 00000100:00100000:3.0:1787614211.261197:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692281472 00000100:00100000:3.0:1787614211.261199:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692281472 00000100:00100000:1.0:1787614211.261205:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787614211.261210:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1874448692280960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787614211.261234:0:24165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000100:00100000:3.0:1787614211.261453:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787614211.261458:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1874448692281088:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787614211.261667:0:24657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:3.0:1787614211.261692:0:24657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef0a90 00002000:00100000:3.0:1787614211.261705:0:24657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b5d43932800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787614211.261710:0:24657:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787614211.261712:0:24657:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:1.0:1787614211.261811:0:24165:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9719586bc2ef0a89 00002000:00100000:1.0:1787614211.261819:0:24165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b5e7d494800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787614211.261823:0:24165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787614211.261825:0:24165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787614211.261877:0:24165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787614211.261900:0:24165:0:(import.c:65:import_set_state_nolock()) ffff8b5e7d496000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1787614211.261903:0:24657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787614211.261914:0:24657:0:(import.c:65:import_set_state_nolock()) ffff8b5d43935000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787614211.261953:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1874448692281088:12345-0@lo:8:kworker.0 Request processed in 490us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614211.261960:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787614211.261974:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787614211.262003:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1874448692280960:12345-0@lo:8:kworker.0 Request processed in 790us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.262010:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787614211.262064:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1874448692281472:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787614211.262082:0:24657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:3.0:1787614211.262195:0:24657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9719586bc2ef0a97 00002000:00100000:3.0:1787614211.262202:0:24657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8b5d43933800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787614211.262205:0:24657:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787614211.262207:0:24657:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787614211.262231:0:24657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787614211.262243:0:24657:0:(import.c:65:import_set_state_nolock()) ffff8b5d43930800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787614211.262275:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3634:x1874448692281472:12345-0@lo:8:kworker.0 Request processed in 290us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614211.262281:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787614211.262322:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7614aa00 x1874448692280960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787614236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.262332:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787614211.262339:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787614211.262347:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787614211.262353:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787614211.262356:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e4608e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787614211.263771:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787614211.263784:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692280960:0@lo:8:kworker.0 00000004:00080000:1.0:1787614211.263802:0:22680:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00010000:00080000:3.0:1787614211.263820:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e76149180 x1874448692281088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787614236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614211.263822:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22680:1874448692282368:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787614211.263830:0:3634:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787614211.263836:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787614211.263843:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787614211.263847:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787614211.263854:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e67931800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787614211.263876:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787614211.263880:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1874448692281088:0@lo:8:kworker.0 00000100:00100000:1.0:1787614211.263896:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787614211.263897:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e48471c00 x1874448692281472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787614236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787614211.263907:0:3634:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787614211.263911:0:3634:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787614211.263914:0:3634:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787614211.263916:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8b5e48565800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787614211.263917:0:22680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e50bd79c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787614211.263927:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787614211.263930:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1874448692281472:0@lo:8:kworker.0 00000100:00100000:1.0:1787614211.263932:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787614211.263942:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692282240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787614211.263966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787614211.263976:0:22682:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787614211.263990:0:22682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f69b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22682:1874448692282624:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787614211.263991:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282240 00000100:00100000:1.0:1787614211.263997:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282240 00000100:00100000:3.0:1787614211.264014:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.264028:0:22682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763b0540 going to sleep for 11 seconds 00000004:00080000:3.0:1787614211.264042:0:22681:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787614211.264047:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787614211.264054:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874448692282240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787614211.264076:0:24167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787614211.264113:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874448692282240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000004:00080000:3.0:1787614211.264119:0:22681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708461960822ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787614211.264119:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00080000:00080000:3.0:1787614211.264125:0:22681:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1787614211.264140:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787614211.264171:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e763c7b80 x1874448692282240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787614211.264180:0:23402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787614211.264184:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692282240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787614211.264194:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f69aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23402:1874448692282880:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787614211.264217:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282368 00000100:00100000:3.0:1787614211.264218:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614211.264220:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282368 00000100:00100000:3.0:1787614211.264235:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787614211.264240:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282624 00000100:00100000:1.0:1787614211.264242:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282624 00000100:00100000:1.0:1787614211.264384:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282880 00000100:00100000:1.0:1787614211.264387:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282880 00000100:00100000:1.0:1787614211.264409:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787614211.264415:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22680:x1874448692282368:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787614211.264606:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787614211.264615:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22682:x1874448692282624:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1787614211.264739:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787614211.264751:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692282496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787614211.264779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614211.264800:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787614211.264806:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692282752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787614211.264828:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614211.264858:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282496 00000100:00100000:1.0:1787614211.264872:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282496 00000100:00100000:1.0:1787614211.264890:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692282752 00000100:00100000:1.0:1787614211.264893:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692282752 00000100:00100000:1.0:1787614211.264904:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787614211.264910:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1874448692282496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787614211.264921:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:1.0:1787614211.264958:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1874448692282496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.264964:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787614211.264977:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787614211.264984:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1874448692282752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787614211.264992:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:1.0:1787614211.265013:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1874448692282752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614211.265019:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787614211.265045:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7f698380 x1874448692282752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614211.265058:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692282752:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787614211.265067:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7f698700 x1874448692282496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614211.265078:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692282496:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787614211.265737:0:22679:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787614211.265814:0:22679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708463655115ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787614211.265821:0:22679:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787614211.265836:0:23401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787614211.265885:0:23401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 708463726678ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787614211.265890:0:23401:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1787614211.268068:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e48470700 x1874448692281600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.268085:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692281600:0@lo:400:kworker.0 00010000:00080000:3.0:1787614211.268111:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e777f4e00 x1874448692282112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.268120:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692282112:0@lo:400:kworker.0 00000100:00100000:3.0:1787614211.268133:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692280832:0@lo:400:kworker.0 00010000:00080000:3.0:1787614211.268145:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e777f4700 x1874448692281728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614211.268153:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692281728:0@lo:400:kworker.0 00000004:00080000:1.0:1787614211.269325:0:23390:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787614211.270987:0:24165:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787614211.270999:0:24165:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1787614211.271004:0:24165:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00080000:1.0:1787614211.274819:0:24162:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787614211.274830:0:24162:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787614211.274835:0:24162:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:2.0:1787614211.294027:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.294048:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294065:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.294069:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.294076:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294095:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294107:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294115:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294134:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.294145:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.294150:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294178:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.294182:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294191:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294216:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294223:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0a9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.294241:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.294243:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.294245:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787614211.296024:0:22635:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787614211.297148:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.297180:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297198:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.297203:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.297210:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297227:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297238:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297247:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297274:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.297287:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.297292:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297300:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.297305:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297315:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297332:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297339:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0aa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.297355:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.297356:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.297358:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787614211.302541:0:22635:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787614211.303596:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.303742:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303774:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.303780:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.303787:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303801:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303812:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303821:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303842:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.303855:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.303870:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303879:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.303884:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303893:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303921:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303929:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0aac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.303947:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.303949:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.303950:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.309190:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.310614:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310635:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.310640:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.310645:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310663:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310673:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310681:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310737:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.310750:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.310755:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310763:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e40030800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.310768:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310778:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310794:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310803:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003113176/0x9719586bc2ef0ab3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.310821:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.310822:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.310824:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.311757:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.311766:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.311780:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.311784:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.311789:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.311804:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.311813:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.311820:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.311841:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.312700:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.312709:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312720:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41669c00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.312731:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312741:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312758:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312765:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027169eee/0x9719586bc2ef0aba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312783:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.312785:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.312787:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.312871:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.312878:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312889:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.312893:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.312898:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312907:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312915:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312929:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312945:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.312955:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.312959:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312966:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e40031e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.312969:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312978:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312989:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.312997:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc770583/0x9719586bc2ef0ac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.313009:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.313011:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.313013:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.313428:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.313436:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.313446:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.313449:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.313453:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.313488:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.313497:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.313504:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.313523:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.313904:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.313916:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.313924:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41668400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.313927:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.313935:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.313971:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.313979:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c557ce/0x9719586bc2ef0ac8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.313995:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.313996:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.313998:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.315412:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.315424:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315438:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.315442:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.315447:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315461:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315602:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315627:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315648:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787614211.315661:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614211.315667:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315675:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41668200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.315679:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315687:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315701:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315708:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d0a1264/0x9719586bc2ef0acf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315722:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.315724:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.315726:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.315930:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.315943:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315953:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.315957:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.315961:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315972:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315980:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.315988:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.316003:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787614211.316011:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614211.316016:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.316023:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41669200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.316027:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.316034:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.316052:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.316060:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086aae648/0x9719586bc2ef0ad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.316073:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.316075:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.316077:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.317649:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.317660:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.317675:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.317679:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.317685:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.317698:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.317708:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.317714:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.317752:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787614211.318794:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614211.318812:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.318824:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614211.318830:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.318839:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.318877:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.318899:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d326a5c/0x9719586bc2ef0add lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.318918:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.318920:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.318922:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.319678:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.319688:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.319701:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.319705:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.319711:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.319722:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.319731:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.319738:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.319763:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787614211.319939:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614211.319946:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.319954:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614211.319959:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.319966:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.319979:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.319985:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aea7b55/0x9719586bc2ef0ae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.319999:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.320001:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.320002:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.320037:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.320044:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.320052:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.320055:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.320058:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.320081:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.320088:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.320094:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.320113:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787614211.320155:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614211.320179:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.320186:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e40031000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614211.320189:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.320197:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.320210:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.320217:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928ea480/0x9719586bc2ef0aeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.320231:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.320233:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.320234:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.324822:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.324839:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324873:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.324878:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.324885:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324901:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324912:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324933:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324954:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.324970:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.324975:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324983:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.324988:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.324997:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325015:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325022:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76af5c6/0x9719586bc2ef0af2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325040:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.325042:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.325044:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.325287:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.325300:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325309:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.325312:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.325317:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325327:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325335:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325343:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325358:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.325366:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.325371:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325377:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.325380:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325388:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325405:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325412:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0af9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.325425:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.325427:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.325428:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.330679:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.330692:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330708:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.330714:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.330720:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330733:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330743:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330751:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330783:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.330795:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.330800:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330807:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.330812:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330820:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330836:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330842:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0b00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.330857:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.330877:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.330879:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.332753:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.332764:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332779:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.332790:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.332797:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332810:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332821:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332828:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332846:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.332857:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.332874:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332882:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.332887:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332896:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332911:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332929:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0b07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.332946:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.332948:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.332950:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.335782:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.335797:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335814:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.335819:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.335824:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335838:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335849:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335857:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335899:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.335911:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.335917:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335924:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.335929:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335938:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335954:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335961:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.335976:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.335978:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.335980:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.337850:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.337872:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.337888:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.337899:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.337905:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.337919:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.337928:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.337936:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.337968:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787614211.338011:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614211.338018:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.338026:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.338036:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.338043:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.338058:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.338065:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0b15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.338080:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.338082:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.338083:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.338996:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.339004:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.339016:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.339019:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.339025:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.339035:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.339043:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.339058:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787614211.339878:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.339886:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.339897:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.339901:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.339905:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.339916:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.339925:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.339939:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.340072:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787614211.341596:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.341622:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.341636:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.341641:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.341646:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.341658:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.341889:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.341897:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342354:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787614211.342372:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787614211.342380:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342391:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.342397:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342406:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342423:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342430:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0b1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342449:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787614211.342454:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342788:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153c00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.342792:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342800:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342811:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342819:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ad2dcc2/0x9719586bc2ef0b23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342835:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614211.342839:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342845:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.342848:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342856:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342878:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.342896:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.342898:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.342900:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.343998:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.345925:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.345938:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.345955:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.345959:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.345965:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.345979:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.345990:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.345998:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.346017:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787614211.346029:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614211.346034:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.346056:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.346061:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.346070:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.346088:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.346095:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db162a39/0x9719586bc2ef0b31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.346111:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.346113:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.346114:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.346511:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787614211.346520:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a0366b/0x9719586bc2ef0b2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.346562:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.348191:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.348205:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348220:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.348224:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.348231:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348244:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348254:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348262:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348283:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.348294:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.348299:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348306:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.348319:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348330:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348345:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348352:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0b38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.348366:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.348368:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.348370:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787614211.348674:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.348681:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.348690:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.348693:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.348696:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.348706:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.348720:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.348727:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.348781:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787614211.349916:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.349926:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.349940:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.349944:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.349948:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.349960:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.349969:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.349983:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787614211.350131:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.350137:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.350145:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.350148:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.350152:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.350278:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.350285:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.350292:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351112:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787614211.351131:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787614211.351138:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351148:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.351152:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351177:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351197:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351205:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000936c7bb5/0x9719586bc2ef0b3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351224:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787614211.351228:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351248:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.351252:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351260:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351272:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351278:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033459138/0x9719586bc2ef0b46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351292:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.351296:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351303:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.351306:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351314:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351325:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.351341:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.351343:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.351345:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.351715:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.352337:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.352345:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.352357:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.352362:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.352367:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.352434:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787614211.352441:0:24162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329aa57a/0x9719586bc2ef0b4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.352463:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.352580:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.352592:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.352725:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.352788:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787614211.353180:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.353186:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.353206:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.353210:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.353215:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.353225:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.353234:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.353242:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353299:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787614211.353305:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353314:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.353318:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353326:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353341:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353348:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000280914ee/0x9719586bc2ef0b54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353363:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.353372:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787614211.353376:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.353379:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149a600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.353381:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.353390:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.353393:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.353394:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.353398:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353408:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.353409:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.353417:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353419:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.353425:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353427:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.353429:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.353431:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.353443:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.353450:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.353454:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353461:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152c00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.353464:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353472:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353609:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353624:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013ef65e/0x9719586bc2ef0b62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.353638:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.353640:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.353642:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.354121:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787614211.354128:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed387f8/0x9719586bc2ef0b5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787614211.354735:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.354742:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.354754:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.354758:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.354763:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.354786:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.354796:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.354803:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.355081:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.355088:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.355097:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149a400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.355102:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.355111:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.355127:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.355137:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.355139:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.355141:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.355245:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787614211.355251:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a579b44/0x9719586bc2ef0b69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787614211.355926:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.355933:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.355944:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.355947:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.355952:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.355963:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.355982:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.355989:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.356905:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.356916:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.356942:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149b800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.356947:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.356957:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.356974:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.356984:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.356985:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.356987:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.357153:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787614211.357172:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f64bb712/0x9719586bc2ef0b70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787614211.359734:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.359747:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.359763:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.359768:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.359775:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.359798:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.359808:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.359816:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787614211.361148:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.361178:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.361193:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.361197:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.361203:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.361216:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.361226:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.361246:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361374:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787614211.361765:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361776:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f1a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.361780:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361790:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361808:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361825:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.361828:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361835:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149a200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.361839:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361846:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361857:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.361876:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.361878:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.361880:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.363001:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787614211.363013:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f5d605b/0x9719586bc2ef0b7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787614211.363632:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.363639:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.363651:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.363655:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.363830:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.363846:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.363855:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.363874:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.363895:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787614211.364209:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.364215:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364224:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.364227:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.364231:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364240:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364248:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364254:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364263:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787614211.364716:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787614211.364724:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364739:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149aa00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.364744:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364753:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364769:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364777:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b03d2580/0x9719586bc2ef0b85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787614211.364789:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787614211.364793:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.364795:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364796:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364803:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149ae00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.364805:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1787614211.364806:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364814:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614211.364814:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364819:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364824:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364827:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364835:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364844:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364845:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030524baa/0x9719586bc2ef0b8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.364853:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787614211.364868:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787614211.364871:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364877:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149ac00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614211.364880:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364887:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364896:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364903:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fdd42e6/0x9719586bc2ef0b93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614211.364914:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.364916:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614211.364917:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.364995:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.365268:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.365274:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.365282:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.365285:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.365289:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.365297:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.365305:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.365319:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.365338:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.365526:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.365532:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.365540:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e4149b600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.365543:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.365563:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.365775:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.365784:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031963063/0x9719586bc2ef0b9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.365800:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.365802:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.365804:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.365963:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787614211.365971:0:24162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30bfeb7/0x9719586bc2ef0b77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787614211.367021:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.367033:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.367046:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.367051:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.367058:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.367070:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.367092:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.367100:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.367129:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787614211.367387:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.367394:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.367485:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.367489:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.367493:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.367504:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.367512:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.367519:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.367535:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787614211.367937:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787614211.367945:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.367955:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f0a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.367960:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.367969:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.367986:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368006:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000890e2c33/0x9719586bc2ef0ba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368029:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.368033:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368041:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.368044:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368051:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368062:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368069:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a043600/0x9719586bc2ef0ba8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.368084:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.368086:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.368087:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.368094:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.368846:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.368854:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.368886:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.368890:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.368895:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.368906:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.368914:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.368922:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787614211.369058:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.369065:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.369074:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.369077:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.369081:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.369091:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.369100:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.369107:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369204:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787614211.369447:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787614211.369587:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787614211.369594:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369613:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.369618:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369628:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369655:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369671:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae157f54/0x9719586bc2ef0baf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369690:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.369693:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369700:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.369703:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369710:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369720:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369727:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ca26a4/0x9719586bc2ef0bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.369741:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.369742:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.369750:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.370438:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.370447:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.370459:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.370463:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.370468:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.370479:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.370488:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.370495:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.370511:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.370869:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.370875:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.370883:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.370887:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.370896:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.370910:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.370916:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095047254/0x9719586bc2ef0bbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.370931:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.370933:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.370934:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.371121:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.371127:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.371136:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.371146:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.371150:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.371192:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.371201:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.371207:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.371222:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.371489:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.371495:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.371503:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.371506:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.371527:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.371539:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.371545:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000968b55f5/0x9719586bc2ef0bc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.371561:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.371563:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.371564:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.372065:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.372073:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.372082:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.372085:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.372090:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.372100:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.372109:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.372122:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.372136:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.372512:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.372518:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372526:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39600 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.372530:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372539:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372553:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372573:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e829af19/0x9719586bc2ef0bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372591:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.372593:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.372594:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.372654:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.372659:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372799:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.372803:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.372808:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372820:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372828:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372834:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372850:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787614211.372869:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.372878:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372885:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af98000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.372888:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372895:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372905:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372912:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068364558/0x9719586bc2ef0bd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.372926:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.372928:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.372929:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.373139:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.373146:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373154:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.373191:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.373196:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373206:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373213:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373219:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373234:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787614211.373804:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.373811:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373826:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.373830:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.373834:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373843:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373850:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373856:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.373877:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787614211.374054:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787614211.374061:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374068:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.374072:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374093:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374105:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374111:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3aff19d/0x9719586bc2ef0bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374128:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.374131:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374138:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.374140:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374147:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374174:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374182:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f439a7/0x9719586bc2ef0be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.374206:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.374208:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.374209:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.374629:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.374635:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.374645:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.374648:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.374653:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.374673:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.374694:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.374701:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.374721:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.375050:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.375057:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.375071:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.375076:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.375085:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.375098:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.375105:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009239152c/0x9719586bc2ef0be7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.375124:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.375126:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.375127:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.375463:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.375470:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.375480:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.375484:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.375489:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.375499:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.375506:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.375513:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.375574:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787614211.376175:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.376182:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.376193:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.376196:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.376201:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.376211:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.376220:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.376227:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376341:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787614211.376347:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376355:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.376359:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376369:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376407:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376414:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0bee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376431:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.376434:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376440:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38c00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.376443:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376450:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376459:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376466:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.376468:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.376469:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.376587:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787614211.376592:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000953758bf/0x9719586bc2ef0bf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.376793:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.377196:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.377203:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.377221:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.377225:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.377230:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.377240:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.377249:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.377257:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.377783:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.378103:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.378112:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.378128:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.378132:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.378141:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.378175:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.378184:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0bfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.378203:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.378205:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.378207:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.378316:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.378323:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.378332:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.378336:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.378341:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.378351:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.378376:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.378508:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.378563:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787614211.378877:0:24165:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1787614211.378982:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22680:x1874448692282368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 114563us (115082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614211.378993:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787614211.379026:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787614211.379037:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874448692282880:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:2.0:1787614211.379792:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787614211.379802:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.379813:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614211.379818:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.379828:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.379845:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.379853:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8327f0e/0x9719586bc2ef0c03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.379888:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.379890:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787614211.379891:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.379970:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.379977:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.379999:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.380004:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.380010:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.380022:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.380030:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.380037:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.380056:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787614211.380304:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614211.380309:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.380317:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614211.380321:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.380328:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.380340:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.380355:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a0366b/0x9719586bc2ef0c0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.380371:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.380373:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.380375:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614211.381391:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22680:1874448692282368:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787614211.382269:0:22680:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1787614211.382319:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22680:1874448692283008:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787614211.382394:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614211.382495:0:22680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e76309a80 going to sleep for 11 seconds 00002000:00010000:2.0:1787614211.382574:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.382582:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614211.382840:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787614211.383734:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:3.0:1787614211.383803:0:24165:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787614211.383809:0:24165:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787614211.383892:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874448692282880:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4856us (119670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614211.383902:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787614211.383951:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f69aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23402:1874448692282880:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787614211.383963:0:23402:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787614211.383989:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f69aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23402:1874448692283136:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787614211.384014:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.384032:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787614211.384045:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283008 00000100:00100000:3.0:1787614211.384050:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283008 00000100:00100000:3.0:1787614211.384073:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283136 00000100:00100000:3.0:1787614211.384075:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283136 00000100:00100000:3.0:1787614211.384086:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787614211.384093:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22680:x1874448692283008:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787614211.384123:0:24657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1787614211.384502:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.384507:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.384515:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.384533:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.384544:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.384552:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.384595:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.385150:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.385167:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.385177:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51718000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.385181:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.385191:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.385214:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.385221:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d04809d/0x9719586bc2ef0c11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.385241:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.385243:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.385244:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.385831:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.385839:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.385852:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.385856:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.385871:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.385882:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.385903:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.385910:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.385932:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.386778:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.386787:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.386799:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51718800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.386804:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.386813:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.386828:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.386836:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d131018e/0x9719586bc2ef0c18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.386879:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.386881:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.386883:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.387091:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.387099:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.387109:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.387113:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.387118:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.387129:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.387138:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.387145:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.387201:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.387906:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.387912:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.387922:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.387927:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.387936:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.387949:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.387957:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004edfc953/0x9719586bc2ef0c1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.387972:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.387974:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.387975:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.388208:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.388340:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.388347:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.388358:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.388362:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.388367:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.388378:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.388762:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.388772:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.388792:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.389768:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.389777:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.389795:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.389799:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.389808:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.389823:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.389830:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055750867/0x9719586bc2ef0c26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.389845:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.389847:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.389848:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787614211.389917:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787614211.389924:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.389933:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=708s v=(0 0) 00010000:00010000:2.0:1787614211.389941:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614211.389946:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.389957:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.389965:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.389971:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614211.389992:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.390363:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.390369:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.390377:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.390391:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.390479:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.390499:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.390506:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0c2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.390520:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.390522:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.390524:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787614211.393926:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787614211.393945:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.393961:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1787614211.393965:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614211.393971:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.393984:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.393993:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394001:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394022:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787614211.394034:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614211.394039:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394047:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38800 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614211.394052:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394061:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394083:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394090:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de1581c/0x9719586bc2ef0c34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614211.394111:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.394112:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614211.394114:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614211.396068:0:25063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787614211.396083:0:25063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23402:x1874448692283136:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787614211.396114:0:25063:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787614211.396204:0:25063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23402:x1874448692283136:12345-0@lo:5:osp-pre-1-1.0 Request processed in 126us (12189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614211.396211:0:25063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787614211.396390:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f69aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23402:1874448692283136:0@lo:5:osp-pre-1-1.0 00002000:00010000:0.0:1787614211.396754:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.396763:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396778:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.396782:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.396788:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396800:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396822:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396829:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396845:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.396855:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.396870:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396878:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.396882:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396891:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396907:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396914:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae04f4e/0x9719586bc2ef0c3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.396931:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.396937:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.396939:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.398099:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.398109:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.398122:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.398126:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.398132:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.398143:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.398152:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.398175:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.398194:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787614211.398850:0:24159:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787614211.398903:0:24159:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787614211.398972:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.398979:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.398989:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.399001:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.399006:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399017:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399025:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399032:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399049:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787614211.399059:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787614211.399065:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399073:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044400 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.399077:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399086:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399100:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399118:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008018d8d4/0x9719586bc2ef0c42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399136:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.399139:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399145:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045000 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.399149:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399181:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399193:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399200:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a10eda59/0x9719586bc2ef0c49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399212:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.399213:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.399215:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787614211.399954:0:24162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787614211.399961:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399976:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1787614211.399980:0:24162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614211.399984:0:24162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.399993:0:24162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400001:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400008:0:24162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400023:0:24162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787614211.400033:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614211.400036:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400043:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044e00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614211.400047:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400054:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400075:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400082:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76af5c6/0x9719586bc2ef0c50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614211.400095:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.400097:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614211.400099:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787614211.400140:0:24162:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1787614211.400247:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22682:x1874448692282624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 135630us (136228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614211.400257:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:3.0:1787614211.400433:0:23402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787614211.400490:0:22682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f69b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22682:1874448692282624:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787614211.400499:0:22682:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787614211.400535:0:22682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f69b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22682:1874448692283264:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787614211.400568:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.400607:0:22682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e59697180 going to sleep for 11 seconds 00010000:00010000:3.0:1787614211.400638:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614211.400722:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22680:x1874448692283008:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16629us (18328us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787614211.400730:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787614211.400745:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283264 00000100:00100000:3.0:1787614211.400751:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283264 00000100:00100000:3.0:1787614211.400784:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787614211.400792:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22682:x1874448692283264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787614211.400831:0:24657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1787614211.400963:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f698000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23402:1874448692283392:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787614211.400993:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614211.401011:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763b0540 going to sleep for 11 seconds 00000100:00100000:0.0:1787614211.401066:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283392 00000100:00100000:0.0:1787614211.401071:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283392 00000100:00100000:0.0:1787614211.401106:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787614211.401114:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874448692283392:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787614211.401133:0:24165:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:0.0:1787614211.405355:0:24980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787614211.405409:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787614211.405413:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787614211.405685:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f69aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22682:x1874448692283264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4889us (5112us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787614211.405697:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787614211.406136:0:22680:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787614211.406146:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22680:1874448692283008:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787614211.406187:0:22680:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1787614211.410964:0:22682:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787614211.410977:0:22682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f69b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22682:1874448692283264:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787614211.410993:0:22682:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:3.0:1787614211.416008:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874448692283392:12345-0@lo:5:osp-pre-1-1.0 Request processed in 14888us (15007us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787614211.416020:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787614211.416241:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f698000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23402:1874448692283392:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787614211.416328:0:23402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1787614211.416378:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1874448692283520:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787614211.416561:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614211.416592:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e678de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614211.416737:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283520 00000100:00100000:2.0:1787614211.416746:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283520 00000100:00100000:2.0:1787614211.416794:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787614211.416803:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1874448692283520:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787614211.416868:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1874448692283520:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614211.416876:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787614211.416931:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e763c6300 x1874448692283520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787614227 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614211.416948:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e763c6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1874448692283520:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787614211.954229:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787614212.210679:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787614212.210686:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e51a93800 from 14 10000000:01000000:1.0:1787614212.210692:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787614212.210736:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614212.210748:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614212.210758:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614212.210782:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692283648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787614212.210843:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614212.210899:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e678de180 going to sleep for 11 seconds 00000100:00100000:2.0:1787614212.210967:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283648 00000100:00100000:2.0:1787614212.210974:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283648 00000100:00100000:2.0:1787614212.211031:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787614212.211041:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692283648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614212.211052:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614212.211063:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51718a00/0x9719586bc2ef0c5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0c57 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211086:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51718a00/0x9719586bc2ef0c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0c57 expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211095:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51718a00/0x9719586bc2ef0c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0c57 expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211104:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51718a00, rc 0) 00000100:00100000:2.0:1787614212.211143:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692283648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614212.211150:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787614212.211213:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692283648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614212.211225:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0c5e expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211233:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0c5e expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614212.211278:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692283776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787614212.211309:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614212.211323:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6de1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787614212.211336:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283776 00000100:00100000:2.0:1787614212.211339:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283776 00000100:00100000:2.0:1787614212.211370:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787614212.211390:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692283776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787614212.211403:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787614212.211419:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787614212.211422:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787614212.211496:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692283776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614212.211503:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787614212.211533:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692283776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787614212.211586:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787614212.211592:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0c5e expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211601:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e7d152200/0x9719586bc2ef0c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0c5e expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787614212.211609:0:22652:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787614212.211611:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5e7af67800 from 14 10000000:01000000:2.0:1787614212.211613:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787614212.211628:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211636:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211644:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614212.211655:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692283904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787614212.211687:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614212.211701:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6de1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787614212.211712:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692283904 00000100:00100000:2.0:1787614212.211715:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692283904 00000100:00100000:2.0:1787614212.211735:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787614212.211741:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692283904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614212.211749:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614212.211755:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51719800/0x9719586bc2ef0c6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0c65 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211768:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51719800/0x9719586bc2ef0c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0c65 expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211776:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51719800/0x9719586bc2ef0c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0c65 expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211783:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51719800, rc 0) 00000100:00100000:2.0:1787614212.211809:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692283904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614212.211814:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787614212.211843:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692283904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614212.211853:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0c6c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.211873:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0c6c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614212.211911:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692284032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787614212.211946:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614212.211959:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e6de1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787614212.211970:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284032 00000100:00100000:2.0:1787614212.211973:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284032 00000100:00100000:2.0:1787614212.211993:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787614212.211998:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692284032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787614212.212008:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787614212.212019:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787614212.212022:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787614212.212085:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692284032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614212.212092:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787614212.212123:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692284032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787614212.212195:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787614212.212201:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0c6c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614212.212207:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e51718200/0x9719586bc2ef0c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0c6c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787614212.785867:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787614212.977293:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787614214.001685:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614214.450598:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787614214.455834:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692284160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787614214.456117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614214.456377:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284160 00000100:00100000:2.0:1787614214.456385:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284160 00000100:00100000:2.0:1787614214.456444:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787614214.456454:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7f698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692284160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787614214.456496:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787614214.456543:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7f698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692284160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614214.456550:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787614214.456781:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614214.456825:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692284160:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787614215.025258:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614215.985394:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692284288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787614215.985462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614215.985537:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284288 00000100:00100000:2.0:1787614215.985545:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284288 00000100:00100000:2.0:1787614215.985590:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787614215.985599:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692284288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787614215.985636:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787614215.985684:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692284288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614215.985692:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787614215.985741:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692284288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787614215.987407:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787614215.987428:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692284416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787614215.987487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614215.988136:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284416 00000100:00100000:1.0:1787614215.988147:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284416 00000100:00100000:1.0:1787614215.988237:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787614215.988246:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692284416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787614215.988278:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787614215.988332:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692284416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614215.988340:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787614215.988389:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692284416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787614216.049318:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614216.497367:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692284544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787614216.497438:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.497491:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692284672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787614216.497517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.497537:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787614216.497543:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692284800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787614216.497565:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.497584:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284544 00000100:00100000:1.0:1787614216.497591:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284544 00000100:00100000:1.0:1787614216.497638:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284672 00000100:00100000:1.0:1787614216.497641:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284672 00000100:00100000:1.0:1787614216.497654:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284800 00000100:00100000:1.0:1787614216.497657:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284800 00000100:00100000:1.0:1787614216.497672:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787614216.497675:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787614216.497679:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787614216.497680:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692284544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787614216.497710:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787614216.497763:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692284544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.497770:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787614216.497786:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787614216.497792:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874448692284672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787614216.497802:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787614216.497843:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874448692284672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.497850:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787614216.497882:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787614216.497888:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692284800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787614216.497911:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787614216.497942:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692284544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787614216.497950:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692284800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.497956:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787614216.497985:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692284800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787614216.497999:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692284672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787614216.499066:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f69b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692284928:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499115:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499177:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692285440:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499227:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787614216.499233:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692285056:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499252:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499267:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692285568:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499314:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285440 00000100:00100000:1.0:1787614216.499320:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285440 00000100:00100000:1.0:1787614216.499360:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285056 00000100:00100000:1.0:1787614216.499363:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285056 00000100:00100000:1.0:1787614216.499374:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285568 00000100:00100000:1.0:1787614216.499376:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285568 00000100:00100000:1.0:1787614216.499390:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787614216.499503:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692285440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499549:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692285440:12345-0@lo:400:kworker.0 Request processed in 152us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.499565:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787614216.499583:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787614216.499590:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692285056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499619:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692285056:12345-0@lo:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.499625:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787614216.499636:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787614216.499643:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499669:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874448692285568:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.499675:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787614216.499704:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7f698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692285184:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499751:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692285696:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499771:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499788:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787614216.499793:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692285312:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499812:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499827:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692285824:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614216.499891:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285184 00000100:00100000:1.0:1787614216.499895:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285184 00000100:00100000:1.0:1787614216.499929:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787614216.499935:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692285184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.499981:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692285184:12345-0@lo:400:kworker.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.499988:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787614216.500004:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285696 00000100:00100000:1.0:1787614216.500007:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285696 00000100:00100000:1.0:1787614216.500024:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285312 00000100:00100000:1.0:1787614216.500026:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285312 00000100:00100000:1.0:1787614216.500036:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285824 00000100:00100000:1.0:1787614216.500038:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285824 00000100:00100000:1.0:1787614216.500050:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787614216.500055:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692285696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.500082:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692285696:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.500088:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787614216.500100:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787614216.500105:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692285312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.500128:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874448692285312:12345-0@lo:400:kworker.0 Request processed in 23us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.500133:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787614216.500142:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787614216.500148:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874448692285824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.500221:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874448692285824:12345-0@lo:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614216.500227:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787614216.500265:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7f698700 x1874448692285056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614216.500291:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692285056:0@lo:400:kworker.0 00010000:00080000:1.0:1787614216.500306:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e76149180 x1874448692285568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614216.500314:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1874448692285568:0@lo:400:kworker.0 00010000:00080000:1.0:1787614216.500322:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e48470700 x1874448692285440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614216.500329:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692285440:0@lo:400:kworker.0 00010000:00080000:1.0:1787614216.500362:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5d43b86d80 x1874448692285312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614216.500371:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874448692285312:0@lo:400:kworker.0 00010000:00080000:1.0:1787614216.500380:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5d43a49500 x1874448692285824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614216.500387:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1874448692285824:0@lo:400:kworker.0 00000100:00100000:1.0:1787614216.500396:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692285184:0@lo:400:kworker.0 00010000:00080000:1.0:1787614216.500404:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e7614aa00 x1874448692285696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787614216.500411:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7614aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692285696:0@lo:400:kworker.0 00000100:00100000:3.0:1787614216.500758:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692284928 00000100:00100000:3.0:1787614216.500764:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692284928 00000100:00100000:3.0:1787614216.500793:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787614216.500800:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3635:x1874448692284928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614216.500869:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3635:x1874448692284928:12345-0@lo:400:kworker.0 Request processed in 70us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614216.500876:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787614216.501326:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7f69b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692284928:0@lo:400:kworker.0 00000100:00080000:2.0:1787614216.501774:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787614216.501780:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787614216.501783:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787614216.504282:0:24980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:02000400:2.0:1787614216.929484:0:25336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg655-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787614217.078315:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787614217.652875:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787614217.976279:0:25388:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787614217.976561:0:25388:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787614218.100341:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787614218.883295:0:25439:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787614218.883610:0:25439:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787614219.121329:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614219.150272:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614219.151202:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671196928 00000100:00100000:1.0:1787614219.151215:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671196928 00000100:00100000:1.0:1787614219.151263:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:1.0:1787614219.151273:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1874448671196928:12345-192.168.206.55@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787614219.151303:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4a1a9792-e19f-47a1-ac10-c3c97cb0a11a@192.168.206.55@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1787614219.151330:0:22648:0:(genops.c:1385:class_connect()) connect: client 4a1a9792-e19f-47a1-ac10-c3c97cb0a11a, cookie 0x9719586bc2ef0c73 00000100:00080000:1.0:1787614219.151469:0:22648:0:(import.c:65:import_set_state_nolock()) ffff8b5e7d492800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787614219.151534:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+5:2399:x1874448671196928:12345-192.168.206.55@tcp:250:mount.lustre.0 Request processed in 261us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.151543:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 115 00000100:00100000:3.0:1787614219.153473:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614219.153603:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197056 00000100:00100000:2.0:1787614219.153612:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197056 00000100:00100000:2.0:1787614219.153674:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 116 00000100:00100000:2.0:1787614219.153683:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4334dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+5:18037:x1874448671197056:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787614219.153699:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614219.153716:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51719e00/0x9719586bc2ef0c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f977029244144 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614219.153743:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51719e00/0x9719586bc2ef0c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244144 expref: 6 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614219.153754:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51719e00/0x9719586bc2ef0c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244144 expref: 6 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614219.153764:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51719e00, rc 0) 00000100:00100000:2.0:1787614219.153825:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4334dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+6:18037:x1874448671197056:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 134us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.153832:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 116 00000100:00100000:2.0:1787614219.160424:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.162738:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197184 00000100:00100000:3.0:1787614219.162752:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197184 00000100:00100000:3.0:1787614219.162883:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 117 00000100:00100000:3.0:1787614219.162903:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4521b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+6:18037:x1874448671197184:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787614219.163050:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4521b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+6:18037:x1874448671197184:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 147us (2634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787614219.163058:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 117 00000100:00100000:1.0:1787614219.171613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.171756:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197312 00000100:00100000:3.0:1787614219.171767:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197312 00000100:00100000:3.0:1787614219.171834:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 118 00000100:00100000:3.0:1787614219.171845:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+6:18037:x1874448671197312:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787614219.171862:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614219.171879:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5d43b38800/0x9719586bc2ef0c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f97702924414b expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.172552:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5d43b38800/0x9719586bc2ef0c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924414b expref: 7 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.172564:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5d43b38800/0x9719586bc2ef0c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924414b expref: 7 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.172573:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38800, rc 0) 00000100:00100000:3.0:1787614219.172705:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+7:18037:x1874448671197312:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 861us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.172713:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 118 00000100:00100000:0.0:1787614219.181366:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.181747:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197440 00000100:00100000:3.0:1787614219.181770:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197440 00000100:00100000:3.0:1787614219.181892:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:3.0:1787614219.181904:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+7:18037:x1874448671197440:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787614219.182081:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18037:x1874448671197440:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 179us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.182088:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 119 00000100:00100000:2.0:1787614219.188450:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.188596:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197568 00000100:00100000:3.0:1787614219.188607:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197568 00000100:00100000:3.0:1787614219.188673:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:3.0:1787614219.188683:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4521a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18037:x1874448671197568:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787614219.188847:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4521a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18037:x1874448671197568:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.188855:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 120 00000100:00100000:1.0:1787614219.195735:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.195901:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197696 00000100:00100000:3.0:1787614219.195911:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197696 00000100:00100000:3.0:1787614219.196993:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 121 00000100:00100000:3.0:1787614219.197009:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18057:x1874448671197696:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787614219.197186:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18057:x1874448671197696:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 182us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.197195:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 121 00000100:00100000:0.0:1787614219.216285:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614219.216875:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197824 00000100:00100000:2.0:1787614219.216891:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197824 00000100:00100000:2.0:1787614219.216972:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 122 00000100:00100000:2.0:1787614219.216983:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4521b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18057:x1874448671197824:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787614219.217202:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4521b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18057:x1874448671197824:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 177us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.217211:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 122 00000100:00100000:2.0:1787614219.229764:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.230229:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671197952 00000100:00100000:3.0:1787614219.230247:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671197952 00000100:00100000:3.0:1787614219.230332:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 123 00000100:00100000:3.0:1787614219.230354:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e45219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18057:x1874448671197952:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787614219.230585:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e45219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18057:x1874448671197952:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 232us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.230603:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 123 00000100:00100000:1.0:1787614219.245815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614219.246646:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198080 00000100:00100000:2.0:1787614219.246658:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198080 00000100:00100000:2.0:1787614219.246721:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 124 00000100:00100000:2.0:1787614219.246731:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+8:18037:x1874448671198080:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787614219.246746:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614219.246763:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51718000/0x9719586bc2ef0c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f97702924417c expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614219.246791:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51718000/0x9719586bc2ef0c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924417c expref: 9 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614219.246802:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51718000/0x9719586bc2ef0c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924417c expref: 9 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614219.246811:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51718000, rc 0) 00000100:00100000:2.0:1787614219.246901:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+9:18037:x1874448671198080:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 171us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.246909:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 124 00000100:00100000:0.0:1787614219.252909:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614219.253046:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198208 00000100:00100000:1.0:1787614219.253055:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198208 00000100:00100000:1.0:1787614219.253137:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 125 00000100:00100000:1.0:1787614219.253148:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+9:18037:x1874448671198208:12345-192.168.206.55@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787614219.253214:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787614219.253238:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787614219.253243:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787614219.253246:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787614219.253249:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787614219.253252:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787614219.255844:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+9:18037:x1874448671198208:12345-192.168.206.55@tcp:256:mount.lustre.0 Request processed in 2687us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.255859:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 125 00000100:00100000:0.0:1787614219.259635:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.259718:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198336 00000100:00100000:3.0:1787614219.259729:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198336 00000100:00100000:3.0:1787614219.259785:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 126 00000100:00100000:3.0:1787614219.259796:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+9:18037:x1874448671198336:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787614219.259811:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614219.259839:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f977029244183 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.259879:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 10 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.259891:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 10 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.259899:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38c00, rc 0) 00000100:00100000:3.0:1787614219.260199:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18037:x1874448671198336:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 403us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.260206:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 126 00000100:00100000:0.0:1787614219.264627:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614219.264727:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198464 00000100:00100000:1.0:1787614219.264737:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198464 00000100:00100000:1.0:1787614219.264791:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 127 00000100:00100000:1.0:1787614219.264801:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e5360d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18037:x1874448671198464:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787614219.264980:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e5360d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18037:x1874448671198464:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 179us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.264989:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 127 00000100:00100000:0.0:1787614219.267859:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.268058:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198592 00000100:00100000:3.0:1787614219.268069:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198592 00000100:00100000:3.0:1787614219.268128:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:3.0:1787614219.268139:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18037:x1874448671198592:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787614219.268323:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18037:x1874448671198592:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 185us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.268331:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 128 00000100:00100000:0.0:1787614219.278921:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614219.279051:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198720 00000100:00100000:2.0:1787614219.279061:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198720 00000100:00100000:2.0:1787614219.279122:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 129 00000100:00100000:2.0:1787614219.279133:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18062:x1874448671198720:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787614219.279310:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18062:x1874448671198720:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 179us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.279318:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 129 00000100:00100000:0.0:1787614219.284052:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614219.284154:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198848 00000100:00100000:1.0:1787614219.284188:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198848 00000100:00100000:1.0:1787614219.284246:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 130 00000100:00100000:1.0:1787614219.284259:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18062:x1874448671198848:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787614219.284824:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18062:x1874448671198848:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 558us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.284833:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 130 00000100:00100000:0.0:1787614219.293286:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614219.293372:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614219.293645:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671198976 00000100:00100000:2.0:1787614219.293667:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671198976 00000100:00100000:2.0:1787614219.293710:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199232 00000100:00100000:2.0:1787614219.293713:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199232 00000100:00100000:2.0:1787614219.293734:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1787614219.293742:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1874448671198976:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787614219.293772:0:22657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6351567f-8d3a-494f-ba5f-bbc65334b239@192.168.206.55@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1787614219.293833:0:22657:0:(genops.c:1385:class_connect()) connect: client 6351567f-8d3a-494f-ba5f-bbc65334b239, cookie 0x9719586bc2ef0c96 00000004:00100000:2.0:1787614219.293858:0:22657:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787614219.294064:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8b5d440c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614219.294125:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2399:x1874448671198976:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 382us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.294133:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:2.0:1787614219.294148:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:2.0:1787614219.294153:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1874448671199232:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787614219.294195:0:22657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6351567f-8d3a-494f-ba5f-bbc65334b239@192.168.206.55@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1787614219.294227:0:22657:0:(genops.c:1385:class_connect()) connect: client 6351567f-8d3a-494f-ba5f-bbc65334b239, cookie 0x9719586bc2ef0c9d 00000004:00100000:2.0:1787614219.294238:0:22657:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787614219.294360:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8b5d440c4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614219.294382:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2399:x1874448671199232:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 227us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.294388:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:0.0:1787614219.302573:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614219.302607:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614219.302638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614219.302813:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199360 00000100:00100000:1.0:1787614219.302832:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199360 00000100:00100000:1.0:1787614219.302901:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199104 00000100:00100000:1.0:1787614219.302905:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199104 00000100:00100000:1.0:1787614219.302920:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199488 00000100:00100000:1.0:1787614219.302923:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199488 00000100:00100000:1.0:1787614219.302937:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1787614219.302945:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:0:x1874448671199360:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787614219.302981:0:22655:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787614219.303058:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:0:x1874448671199360:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.303065:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1787614219.303096:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:1.0:1787614219.303102:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:0:x1874448671199104:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787614219.303120:0:22655:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614219.303207:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:0:x1874448671199104:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 104us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.303214:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:1.0:1787614219.303229:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:1.0:1787614219.303235:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671199488:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787614219.303246:0:22655:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614219.303268:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671199488:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.303275:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00080000:0.0:1787614219.304219:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787614219.304225:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787614219.314792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614219.315220:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199616 00000100:00100000:1.0:1787614219.315229:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199616 00000100:00100000:1.0:1787614219.315298:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:1.0:1787614219.315309:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671199616:12345-192.168.206.55@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787614219.315505:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671199616:12345-192.168.206.55@tcp:40:mount.lustre.0 Request processed in 197us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.315513:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 12 00000100:00100000:0.0:1787614219.318715:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614219.318756:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614219.318804:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614219.318923:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200000 00000100:00100000:2.0:1787614219.318932:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200000 00000100:00100000:2.0:1787614219.318985:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:2.0:1787614219.318995:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671200000:12345-192.168.206.55@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787614219.319078:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671200000:12345-192.168.206.55@tcp:900:mount.lustre.0 Request processed in 85us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.319086:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:1.0:1787614219.323031:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199744 00000100:00100000:1.0:1787614219.323046:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199744 00000100:00100000:1.0:1787614219.323147:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671199872 00000100:00100000:1.0:1787614219.323151:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671199872 00000100:00100000:1.0:1787614219.323205:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:1.0:1787614219.323214:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874448671199744:12345-192.168.206.55@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787614219.323377:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:2.0:1787614219.323383:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1874448671199872:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787614219.323426:0:24164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6351567f-8d3a-494f-ba5f-bbc65334b239@192.168.206.55@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1787614219.323459:0:24164:0:(genops.c:1385:class_connect()) connect: client 6351567f-8d3a-494f-ba5f-bbc65334b239, cookie 0x9719586bc2ef0ca4 00002000:00100000:2.0:1787614219.323470:0:24164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6351567f-8d3a-494f-ba5f-bbc65334b239/ffff8b5d440c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787614219.323488:0:24164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787614219.323674:0:24164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787614219.323705:0:24164:0:(import.c:65:import_set_state_nolock()) ffff8b5d440c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614219.323774:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2399:x1874448671199872:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 389us (4970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614219.323782:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00010000:00080000:1.0:1787614219.324840:0:24657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6351567f-8d3a-494f-ba5f-bbc65334b239@192.168.206.55@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1787614219.324870:0:24657:0:(genops.c:1385:class_connect()) connect: client 6351567f-8d3a-494f-ba5f-bbc65334b239, cookie 0x9719586bc2ef0cab 00002000:00100000:1.0:1787614219.324880:0:24657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6351567f-8d3a-494f-ba5f-bbc65334b239/ffff8b5e7d197000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787614219.324894:0:24657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787614219.325037:0:24657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787614219.325063:0:24657:0:(import.c:65:import_set_state_nolock()) ffff8b5e7d195800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787614219.325105:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2399:x1874448671199744:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 1890us (6347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614219.325128:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:2.0:1787614219.326779:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.326933:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200128 00000100:00100000:3.0:1787614219.326942:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200128 00000100:00100000:3.0:1787614219.326993:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1787614219.327004:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671200128:12345-192.168.206.55@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787614219.332256:0:22658:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5175us 00000004:00200000:3.0:1787614219.357922:0:22658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787614219.358052:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18037:x1874448671200128:12345-192.168.206.55@tcp:33:mount.lustre.0 Request processed in 31044us (31276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.358063:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:1.0:1787614219.569559:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e48359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692285952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787614219.569627:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614219.569861:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692285952 00000100:00100000:3.0:1787614219.569869:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692285952 00000100:00100000:3.0:1787614219.569937:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787614219.569948:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692285952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787614219.569968:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787614219.570037:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692285952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.570044:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787614219.570348:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e48359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692285952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787614219.570844:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787614219.606368:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614219.606502:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200256 00000100:00100000:3.0:1787614219.606516:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200256 00000100:00100000:3.0:1787614219.606585:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:3.0:1787614219.606601:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18085:x1874448671200256:12345-192.168.206.55@tcp:101:mkdir.0 00010000:00010000:3.0:1787614219.606622:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614219.606648:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39c00/0x9719586bc2ef0cb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292441b4 expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.607241:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0cb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.607270:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.607285:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787614219.607334:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787614219.607533:0:24946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787614219.607576:0:24946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.607607:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39c00/0x9719586bc2ef0cb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441b4 expref: 8 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.607627:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441b4 expref: 7 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614219.607636:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:3.0:1787614219.607640:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787614219.607643:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38600, rc 0) 00000100:00100000:3.0:1787614219.607730:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18085:x1874448671200256:12345-192.168.206.55@tcp:101:mkdir.0 Request processed in 1127us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614219.607738:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00010000:00010000:1.0:1787614220.149057:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614221.105573:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787614221.105601:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692286080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787614221.105681:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614221.105799:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286080 00000100:00100000:3.0:1787614221.105819:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286080 00000100:00100000:3.0:1787614221.105882:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787614221.105893:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692286080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787614221.105927:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787614221.106013:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692286080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614221.106021:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787614221.106139:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787614221.106151:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692286208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614221.106209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614221.106296:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286208 00000100:00100000:2.0:1787614221.106301:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286208 00000100:00100000:2.0:1787614221.106341:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787614221.106349:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692286208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787614221.106367:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787614221.106407:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692286208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614221.106414:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787614221.106464:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692286080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787614221.106498:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692286208:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787614221.169659:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614221.617699:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692286720:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.617784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614221.617826:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1874448692287232:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.617846:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614221.617868:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787614221.617874:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692286336:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.617901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614221.617923:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692286848:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.617945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614221.617959:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692287360:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.617978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614221.618085:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692286592:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618117:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286720 00000100:00100000:0.0:1787614221.618119:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614221.618123:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286720 00000100:00100000:0.0:1787614221.618138:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692287104:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618177:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287232 00000100:00100000:1.0:1787614221.618180:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287232 00000100:00100000:0.0:1787614221.618183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614221.618196:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692287616:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618201:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287360 00000100:00100000:1.0:1787614221.618204:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287360 00000100:00100000:1.0:1787614221.618214:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287104 00000100:00100000:1.0:1787614221.618216:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287104 00000100:00100000:0.0:1787614221.618219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614221.618231:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787614221.618236:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287616 00000100:00100000:0.0:1787614221.618236:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692286464:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618238:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287616 00000100:00100000:1.0:1787614221.618254:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787614221.618255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614221.618262:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692286720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.618270:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692286976:0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.618287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614221.618300:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1874448692287488:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618304:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874448692286720:12345-0@lo:400:kworker.0 Request processed in 44us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618311:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787614221.618316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614221.618327:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287488 00000100:00100000:1.0:1787614221.618330:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287488 00000100:00080000:0.0:1787614221.618333:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787614221.618336:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787614221.618342:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614221.618344:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787614221.618349:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874448692287232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.618349:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692287744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787614221.618372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614221.618374:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874448692287232:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618379:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787614221.618390:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787614221.618395:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287744 00000100:00100000:1.0:1787614221.618396:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692287360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.618399:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287744 00000100:00100000:0.0:1787614221.618428:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614221.618435:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e763c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692287744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787614221.618436:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874448692287360:12345-0@lo:400:kworker.0 Request processed in 40us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618442:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787614221.618453:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00002000:00000024:0.0:1787614221.618456:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787614221.618459:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692287104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618487:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692287104:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614221.618487:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e763c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692287744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618494:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787614221.618494:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787614221.618505:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787614221.618511:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874448692287616:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787614221.618512:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787614221.618546:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874448692287616:12345-0@lo:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618552:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787614221.618562:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787614221.618568:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874448692287488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.618578:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692287744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787614221.618589:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874448692287488:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618594:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787614221.618607:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1874448692287488:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618610:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286848 00000100:00100000:1.0:1787614221.618613:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286848 00000100:00100000:0.0:1787614221.618615:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692287104:0@lo:400:kworker.0 00010000:00080000:0.0:1787614221.618626:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e67193b80 x1874448692287616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787614221.618635:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692287616:0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618655:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286592 00000100:00080000:0.0:1787614221.618655:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787614221.618658:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286592 00000100:00100000:0.0:1787614221.618662:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286464 00000100:00100000:0.0:1787614221.618665:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286464 00000100:00100000:1.0:1787614221.618667:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286976 00000100:00100000:1.0:1787614221.618669:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286976 00000100:00100000:1.0:1787614221.618680:0:25063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787614221.618683:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787614221.618685:0:25063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692286848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.618688:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692286592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.618713:0:25063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692286848:12345-0@lo:400:kworker.0 Request processed in 28us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614221.618714:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692286592:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.618720:0:25063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787614221.618868:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e67193100 x1874448692287360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614221.618878:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1874448692287360:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.618888:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874448692286720:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.618897:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1874448692287232:0@lo:400:kworker.0 00000100:00100000:2.0:1787614221.618917:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692286848:0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.619276:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787614221.619292:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787614221.619299:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692286976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.619335:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692286976:12345-0@lo:400:kworker.0 Request processed in 38us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614221.619341:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787614221.619352:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787614221.619358:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e48358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692286464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.619385:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e48358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692286464:12345-0@lo:400:kworker.0 Request processed in 27us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614221.619390:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787614221.619415:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787614221.619418:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787614221.619439:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692286464:0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.619448:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787614221.619459:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692286976:0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.619468:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e777f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692286592:0@lo:400:kworker.0 00000100:00100000:0.0:1787614221.619536:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692287872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787614221.619577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614221.619606:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692287872 00000100:00100000:0.0:1787614221.619610:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692287872 00000100:00100000:0.0:1787614221.619636:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787614221.619655:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692287872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787614221.619667:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787614221.619699:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692287872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614221.619705:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787614221.619738:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692287872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787614221.619790:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692288000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787614221.619826:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614221.619852:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288000 00000100:00100000:0.0:1787614221.619856:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288000 00000100:00100000:0.0:1787614221.619876:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787614221.619882:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692288000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787614221.619898:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787614221.619929:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692288000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614221.621625:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787614221.621777:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692288000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787614221.624173:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692286336 00000100:00100000:1.0:1787614221.624187:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692286336 00000100:00100000:1.0:1787614221.624254:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787614221.624264:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3637:x1874448692286336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614221.624366:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3637:x1874448692286336:12345-0@lo:400:kworker.0 Request processed in 103us (6462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614221.624373:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787614221.624395:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3637:1874448692286336:0@lo:400:kworker.0 00000040:00080000:2.0:1787614222.004857:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787614222.042285:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.044560:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200384 00000100:00100000:1.0:1787614222.044664:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200384 00000100:00100000:1.0:1787614222.044860:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:1.0:1787614222.044887:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18137:x1874448671200384:12345-192.168.206.55@tcp:41:lfs.0 00000004:00000024:1.0:1787614222.044939:0:22655:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614222.045078:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18137:x1874448671200384:12345-192.168.206.55@tcp:41:lfs.0 Request processed in 195us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.045087:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:1.0:1787614222.054405:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614222.055422:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200512 00000100:00100000:2.0:1787614222.055441:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200512 00000100:00080000:0.0:1787614222.055536:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787614222.055541:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787614222.057560:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:2.0:1787614222.057581:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18137:x1874448671200512:12345-192.168.206.55@tcp:41:lfs.0 00000004:00000024:2.0:1787614222.057640:0:22656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787614222.057761:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18137:x1874448671200512:12345-192.168.206.55@tcp:41:lfs.0 Request processed in 188us (3371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614222.057784:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:2.0:1787614222.068534:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.068649:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200640 00000100:00100000:0.0:1787614222.068662:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200640 00000100:00100000:0.0:1787614222.068751:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:0.0:1787614222.068764:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18137:x1874448671200640:12345-192.168.206.55@tcp:13:lfs.0 00002000:00000024:0.0:1787614222.068795:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787614222.068911:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18137:x1874448671200640:12345-192.168.206.55@tcp:13:lfs.0 Request processed in 148us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614222.068919:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00080000:2.0:1787614222.069094:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787614222.071827:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.072749:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200768 00000100:00100000:0.0:1787614222.072764:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200768 00000100:00100000:0.0:1787614222.072867:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:0.0:1787614222.072880:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18137:x1874448671200768:12345-192.168.206.55@tcp:13:lfs.0 00002000:00000024:0.0:1787614222.072914:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787614222.073038:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18137:x1874448671200768:12345-192.168.206.55@tcp:13:lfs.0 Request processed in 160us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614222.073045:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00080000:2.0:1787614222.074329:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787614222.193548:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614222.357488:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.357649:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671200896 00000100:00100000:1.0:1787614222.357664:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671200896 00000100:00100000:1.0:1787614222.357736:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 132 00000100:00100000:1.0:1787614222.357747:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+10:18168:x1874448671200896:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787614222.357770:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614222.357793:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7d153600/0x9719586bc2ef0cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f9770292441bb expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.357847:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7d153600/0x9719586bc2ef0cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441bb expref: 11 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.357860:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7d153600/0x9719586bc2ef0cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441bb expref: 11 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.357870:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153600, rc 0) 00000100:00100000:1.0:1787614222.357950:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18168:x1874448671200896:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 204us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.357968:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 132 00000100:00100000:3.0:1787614222.371135:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.371841:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201024 00000100:00100000:1.0:1787614222.371877:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201024 00000100:00100000:1.0:1787614222.371967:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 133 00000100:00100000:1.0:1787614222.371979:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18168:x1874448671201024:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787614222.372255:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18168:x1874448671201024:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 277us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.372265:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 133 00000100:00100000:0.0:1787614222.383218:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.385517:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201152 00000100:00100000:3.0:1787614222.385539:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201152 00000100:00100000:3.0:1787614222.385975:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 134 00000100:00100000:3.0:1787614222.385991:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18168:x1874448671201152:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787614222.386335:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18168:x1874448671201152:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 337us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.386344:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 134 00000100:00100000:2.0:1787614222.427730:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.427936:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201280 00000100:00100000:3.0:1787614222.427950:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201280 00000100:00100000:3.0:1787614222.428025:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 135 00000100:00100000:3.0:1787614222.428038:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18175:x1874448671201280:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787614222.428285:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18175:x1874448671201280:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 248us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.428294:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 135 00000100:00100000:2.0:1787614222.474349:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.474460:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201408 00000100:00100000:3.0:1787614222.474474:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201408 00000100:00100000:3.0:1787614222.474552:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 136 00000100:00100000:3.0:1787614222.474565:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18175:x1874448671201408:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787614222.474780:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18175:x1874448671201408:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 217us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.474797:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 136 00000100:00100000:0.0:1787614222.481520:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.482461:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201536 00000100:00100000:1.0:1787614222.482479:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201536 00000100:00100000:1.0:1787614222.482555:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 137 00000100:00100000:1.0:1787614222.482567:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18175:x1874448671201536:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787614222.482788:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18175:x1874448671201536:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 221us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.482797:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 137 00000100:00100000:2.0:1787614222.494227:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.494653:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201664 00000100:00100000:1.0:1787614222.494669:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201664 00000100:00100000:1.0:1787614222.494745:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 138 00000100:00100000:1.0:1787614222.494757:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18168:x1874448671201664:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787614222.494779:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614222.494811:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e7d152600/0x9719586bc2ef0cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f9770292441ec expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.494849:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e7d152600/0x9719586bc2ef0cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441ec expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.494861:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e7d152600/0x9719586bc2ef0cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441ec expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.494894:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d152600, rc 0) 00000100:00100000:1.0:1787614222.495015:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18168:x1874448671201664:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 260us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.495023:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 138 00000100:00100000:2.0:1787614222.509463:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.509571:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201792 00000100:00100000:3.0:1787614222.509585:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201792 00000100:00100000:3.0:1787614222.509668:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 139 00000100:00100000:3.0:1787614222.509681:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18168:x1874448671201792:12345-192.168.206.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787614222.509714:0:22650:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787614222.509748:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787614222.509754:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787614222.509758:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787614222.509761:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787614222.509764:0:22650:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787614222.514036:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18168:x1874448671201792:12345-192.168.206.55@tcp:256:mount.lustre.0 Request processed in 4341us (4573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.514055:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 139 00000100:00100000:2.0:1787614222.520652:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.520821:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671201920 00000100:00100000:3.0:1787614222.520834:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671201920 00000100:00100000:3.0:1787614222.520913:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 140 00000100:00100000:3.0:1787614222.520925:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18168:x1874448671201920:12345-192.168.206.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787614222.520945:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614222.520968:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f9770292441f3 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614222.521002:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 13 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614222.521015:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 13 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614222.521048:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b39c00, rc 0) 00000100:00100000:3.0:1787614222.521123:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18168:x1874448671201920:12345-192.168.206.55@tcp:101:mount.lustre.0 Request processed in 199us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.521131:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 140 00000100:00100000:2.0:1787614222.524816:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.524913:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202048 00000100:00100000:3.0:1787614222.524926:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202048 00000100:00100000:3.0:1787614222.524997:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 141 00000100:00100000:3.0:1787614222.525010:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18168:x1874448671202048:12345-192.168.206.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787614222.525301:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18168:x1874448671202048:12345-192.168.206.55@tcp:501:mount.lustre.0 Request processed in 292us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.525311:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 141 00000100:00100000:0.0:1787614222.531448:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.531644:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202176 00000100:00100000:1.0:1787614222.531658:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202176 00000100:00100000:1.0:1787614222.531730:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 142 00000100:00100000:1.0:1787614222.531742:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18168:x1874448671202176:12345-192.168.206.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787614222.531952:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18168:x1874448671202176:12345-192.168.206.55@tcp:503:mount.lustre.0 Request processed in 211us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.531961:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 142 00000100:00100000:2.0:1787614222.535636:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.537293:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202304 00000100:00100000:1.0:1787614222.537312:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202304 00000100:00100000:1.0:1787614222.537408:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 143 00000100:00100000:1.0:1787614222.537420:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18180:x1874448671202304:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787614222.539401:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18180:x1874448671202304:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 1967us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.539418:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 143 00000100:00100000:2.0:1787614222.549432:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.549636:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202432 00000100:00100000:3.0:1787614222.549652:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202432 00000100:00100000:3.0:1787614222.549727:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 144 00000100:00100000:3.0:1787614222.549739:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18180:x1874448671202432:12345-192.168.206.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787614222.550986:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18180:x1874448671202432:12345-192.168.206.55@tcp:502:llog_process_th.0 Request processed in 1237us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.551002:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 144 00000100:00100000:0.0:1787614222.560430:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.560524:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.562726:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.567853:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202560 00000100:00100000:1.0:1787614222.567886:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202560 00000100:00100000:1.0:1787614222.567976:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202816 00000100:00100000:1.0:1787614222.567980:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202816 00000100:00100000:1.0:1787614222.568017:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:1.0:1787614222.568028:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874448671202560:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787614222.568094:0:22655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 519f82bc-988d-4bf1-a38f-1e4913fb5c38@192.168.206.55@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:1.0:1787614222.568150:0:22655:0:(genops.c:1385:class_connect()) connect: client 519f82bc-988d-4bf1-a38f-1e4913fb5c38, cookie 0x9719586bc2ef0cd5 00000004:00100000:1.0:1787614222.568204:0:22655:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787614222.568463:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:2.0:1787614222.568470:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874448671202816:12345-192.168.206.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787614222.568491:0:22656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 519f82bc-988d-4bf1-a38f-1e4913fb5c38@192.168.206.55@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1787614222.568524:0:22656:0:(genops.c:1385:class_connect()) connect: client 519f82bc-988d-4bf1-a38f-1e4913fb5c38, cookie 0x9719586bc2ef0cdc 00000004:00100000:2.0:1787614222.568539:0:22656:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787614222.568635:0:22655:0:(import.c:65:import_set_state_nolock()) ffff8b5e7d196800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787614222.569083:0:22656:0:(import.c:65:import_set_state_nolock()) ffff8b5d440c6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787614222.569150:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2399:x1874448671202816:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 675us (8623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614222.569184:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:2.0:1787614222.569214:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203200 00000100:00100000:2.0:1787614222.569221:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203200 00000100:00100000:2.0:1787614222.569258:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:2.0:1787614222.569267:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2400:x1874448671203200:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614222.569335:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2400:x1874448671203200:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 55us (6612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614222.569342:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:1.0:1787614222.573786:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2399:x1874448671202560:12345-192.168.206.55@tcp:38:mount.lustre.0 Request processed in 5739us (13351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.573819:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:0.0:1787614222.575904:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.575950:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.575982:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614222.576136:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203328 00000100:00100000:2.0:1787614222.576149:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203328 00000100:00100000:2.0:1787614222.576244:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:2.0:1787614222.576257:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2400:x1874448671203328:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614222.576425:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2400:x1874448671203328:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 170us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614222.576434:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:3.0:1787614222.577244:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203584 00000100:00100000:3.0:1787614222.577256:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203584 00000100:00100000:3.0:1787614222.577315:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203456 00000100:00100000:3.0:1787614222.577319:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203456 00000100:00100000:0.0:1787614222.577412:0:25063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:0.0:1787614222.577425:0:25063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2401:x1874448671203584:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1787614222.577498:0:25063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2401:x1874448671203584:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 76us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614222.577505:0:25063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:3.0:1787614222.577584:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:3.0:1787614222.577592:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2401:x1874448671203456:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614222.577716:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2401:x1874448671203456:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 124us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.577723:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:0.0:1787614222.585973:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614222.586027:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.586127:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202944 00000100:00100000:1.0:1787614222.586141:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202944 00000100:00100000:1.0:1787614222.586262:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671202688 00000100:00100000:1.0:1787614222.586265:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671202688 00000100:00100000:1.0:1787614222.586296:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:1.0:1787614222.586307:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:0:x1874448671202944:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787614222.586363:0:22657:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787614222.586445:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:0:x1874448671202944:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 139us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.586453:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:1.0:1787614222.586474:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1787614222.586482:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:0:x1874448671202688:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787614222.586494:0:22657:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614222.586524:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:0:x1874448671202688:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 43us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.586531:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00080000:2.0:1787614222.586833:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787614222.586838:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787614222.599727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.599906:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203072 00000100:00100000:1.0:1787614222.599919:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203072 00000100:00100000:1.0:1787614222.600012:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:1.0:1787614222.600024:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671203072:12345-192.168.206.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787614222.600066:0:22657:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614222.600580:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671203072:12345-192.168.206.55@tcp:41:mount.lustre.0 Request processed in 555us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.600591:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:2.0:1787614222.609738:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.609901:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203712 00000100:00100000:3.0:1787614222.609915:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203712 00000100:00100000:3.0:1787614222.609992:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:3.0:1787614222.610005:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671203712:12345-192.168.206.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787614222.610123:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671203712:12345-192.168.206.55@tcp:40:mount.lustre.0 Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614222.610133:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1787614222.615725:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614222.616201:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204096 00000100:00100000:2.0:1787614222.616215:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204096 00000100:00100000:2.0:1787614222.616292:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:2.0:1787614222.616303:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671204096:12345-192.168.206.55@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787614222.616431:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671204096:12345-192.168.206.55@tcp:900:mount.lustre.0 Request processed in 129us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614222.616440:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:3.0:1787614222.618761:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614222.618831:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.619024:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203840 00000100:00100000:1.0:1787614222.619038:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203840 00000100:00100000:1.0:1787614222.619088:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671203968 00000100:00100000:1.0:1787614222.619092:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671203968 00000100:00100000:1.0:1787614222.619121:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1787614222.619131:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874448671203840:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787614222.619210:0:24165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 519f82bc-988d-4bf1-a38f-1e4913fb5c38@192.168.206.55@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:1.0:1787614222.619252:0:24165:0:(genops.c:1385:class_connect()) connect: client 519f82bc-988d-4bf1-a38f-1e4913fb5c38, cookie 0x9719586bc2ef0ce3 00002000:00100000:1.0:1787614222.619268:0:24165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 519f82bc-988d-4bf1-a38f-1e4913fb5c38/ffff8b5e7d194800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787614222.619284:0:24165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787614222.619386:0:24165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787614222.619422:0:24165:0:(import.c:65:import_set_state_nolock()) ffff8b5e7d190800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787614222.619502:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2399:x1874448671203840:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 370us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.619511:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1787614222.619532:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:1.0:1787614222.619537:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874448671203968:12345-192.168.206.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787614222.619555:0:24165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 519f82bc-988d-4bf1-a38f-1e4913fb5c38@192.168.206.55@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:1.0:1787614222.619574:0:24165:0:(genops.c:1385:class_connect()) connect: client 519f82bc-988d-4bf1-a38f-1e4913fb5c38, cookie 0x9719586bc2ef0cea 00002000:00100000:1.0:1787614222.619601:0:24165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 519f82bc-988d-4bf1-a38f-1e4913fb5c38/ffff8b5e7d197800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787614222.619607:0:24165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787614222.619648:0:24165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787614222.619664:0:24165:0:(import.c:65:import_set_state_nolock()) ffff8b5e7d193000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787614222.619693:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2399:x1874448671203968:12345-192.168.206.55@tcp:8:mount.lustre.0 Request processed in 153us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.619700:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:3.0:1787614222.624308:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614222.624516:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204224 00000100:00100000:2.0:1787614222.624529:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204224 00000100:00100000:2.0:1787614222.624591:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:2.0:1787614222.624613:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671204224:12345-192.168.206.55@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787614222.624755:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787614222.624885:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18168:x1874448671204224:12345-192.168.206.55@tcp:33:mount.lustre.0 Request processed in 282us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614222.624895:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:0.0:1787614222.856525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614222.856820:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204352 00000100:00100000:1.0:1787614222.856833:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204352 00000100:00100000:1.0:1787614222.857066:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:1.0:1787614222.857081:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18203:x1874448671204352:12345-192.168.206.55@tcp:101:mkdir.0 00010000:00010000:1.0:1787614222.857111:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614222.857144:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0cf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244224 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.857256:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.857271:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.857289:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614222.857425:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787614222.857430:0:22655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614222.857458:0:22655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.857514:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0cf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.857537:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614222.857546:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:1.0:1787614222.857549:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787614222.857553:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153800, rc 0) 00000100:00100000:1.0:1787614222.857757:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+7:18203:x1874448671204352:12345-192.168.206.55@tcp:101:mkdir.0 Request processed in 679us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614222.857765:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00010000:00010000:3.0:1787614223.217425:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614224.243860:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614224.689942:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787614224.689975:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692288128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787614224.690081:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614224.690301:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288128 00000100:00100000:0.0:1787614224.690312:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288128 00000100:00100000:0.0:1787614224.690400:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787614224.690412:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692288128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787614224.690448:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787614224.690506:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692288128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614224.690514:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787614224.690580:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692288128:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787614224.690848:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787614224.698288:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 519f82bc-988d-4bf1-a38f-1e4913fb5c38 00000001:00100000:1.0:1787614224.698318:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6351567f-8d3a-494f-ba5f-bbc65334b239 00000001:00100000:0.0:1787614224.698491:0:24159:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 519f82bc-988d-4bf1-a38f-1e4913fb5c38 00000001:00100000:0.0:1787614224.698509:0:24159:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6351567f-8d3a-494f-ba5f-bbc65334b239 00000001:00100000:2.0:1787614224.699985:0:22635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 519f82bc-988d-4bf1-a38f-1e4913fb5c38 00000001:00100000:2.0:1787614224.699998:0:22635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6351567f-8d3a-494f-ba5f-bbc65334b239 00000001:00100000:0.0:1787614224.700339:0:23390:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 519f82bc-988d-4bf1-a38f-1e4913fb5c38 00000001:00100000:0.0:1787614224.701670:0:23390:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6351567f-8d3a-494f-ba5f-bbc65334b239 00010000:00010000:3.0:1787614225.265330:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614226.225345:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787614226.225379:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692288256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614226.225475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614226.225575:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288256 00000100:00100000:0.0:1787614226.225584:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288256 00000100:00100000:0.0:1787614226.225645:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787614226.225656:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692288256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787614226.225701:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787614226.225890:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692288256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 235us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614226.225975:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787614226.226107:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692288256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787614226.226637:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692288384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787614226.226682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614226.226752:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288384 00000100:00100000:1.0:1787614226.226760:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288384 00000100:00100000:1.0:1787614226.226816:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787614226.226826:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692288384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787614226.226857:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614226.237187:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692288384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10325us (10466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614226.237209:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787614226.237454:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692288384:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787614226.246949:0:25537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787614226.290889:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614226.737409:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692288512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787614226.737468:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692288896:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.737501:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614226.737501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614226.737660:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692288768:0@lo:400:kworker.0 00000100:00100000:1.0:1787614226.737751:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692288640:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.740062:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692289024:0@lo:400:kworker.0 00000100:00100000:0.0:1787614226.740095:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692289408:0@lo:400:kworker.0 00000100:00100000:0.0:1787614226.740130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614226.740180:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288512 00000100:00100000:2.0:1787614226.740191:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288512 00000100:00100000:2.0:1787614226.740269:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787614226.740281:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692288512:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787614226.740314:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692289920:0@lo:400:kworker.0 00002000:00000024:2.0:1787614226.740331:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787614226.740339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614226.740377:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692288512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614226.740385:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787614226.740395:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288896 00000100:00080000:2.0:1787614226.740408:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787614226.740424:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614226.740445:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692289536:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.740469:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614226.740489:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787614226.740503:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288896 00000100:00100000:2.0:1787614226.740511:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614226.740546:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787614226.740553:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692288512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787614226.740553:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692288896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.740591:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289408 00000100:00100000:0.0:1787614226.740592:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692288896:12345-0@lo:400:kworker.0 Request processed in 40us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614226.740595:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289408 00000100:00100000:2.0:1787614226.740615:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289920 00000100:00100000:2.0:1787614226.740618:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289920 00000100:00100000:2.0:1787614226.740631:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289024 00000100:00100000:2.0:1787614226.740633:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289024 00000100:00100000:2.0:1787614226.740643:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289536 00000100:00100000:2.0:1787614226.740646:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289536 00000100:00100000:2.0:1787614226.740659:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787614226.740666:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692289408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614226.740672:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614226.740696:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787614226.740697:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874448692289408:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614226.740703:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.740704:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787614226.740714:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787614226.740735:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692289024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614226.740735:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874448692289920:12345-0@lo:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614226.740741:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787614226.740754:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787614226.740767:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874448692289024:12345-0@lo:400:kworker.0 Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614226.740837:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692289536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787614226.740867:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874448692289536:12345-0@lo:400:kworker.0 Request processed in 34us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614226.741202:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787614226.741224:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787614226.741228:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787614226.741231:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787614226.741241:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692290048 00000100:00100000:2.0:1787614226.741246:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692290048 00000100:00100000:2.0:1787614226.741273:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787614226.741281:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692290048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787614226.741331:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00002000:00000024:2.0:1787614226.741336:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787614226.741376:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614226.741393:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787614226.741429:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874448692289024:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.741441:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1874448692289536:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.741456:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787614226.741549:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692288896:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.741561:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874448692289408:0@lo:400:kworker.0 00010000:00080000:2.0:1787614226.741579:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e76369f80 x1874448692289920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614226.741590:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1874448692289920:0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.742620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614226.742702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614226.742801:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692289280:0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.742852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614226.742868:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288640 00000100:00100000:3.0:1787614226.742874:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692289792:0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.742876:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288640 00000100:00100000:3.0:1787614226.742916:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614226.742923:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787614226.742932:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3636:x1874448692288640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.742953:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692288768 00000100:00100000:3.0:1787614226.742957:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692288768 00000100:00100000:3.0:1787614226.742983:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289280 00000100:00100000:3.0:1787614226.742986:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289280 00000100:00100000:3.0:1787614226.743015:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787614226.743021:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692288768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.743063:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692288768:12345-0@lo:400:kworker.0 Request processed in 41us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614226.743070:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787614226.743086:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787614226.743092:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692289280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614226.743110:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692289152:0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.743122:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874448692289280:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614226.743128:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787614226.743180:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787614226.743194:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289792 00000100:00100000:3.0:1787614226.743197:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289792 00000100:00100000:3.0:1787614226.743230:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787614226.743237:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692289792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.743643:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874448692289792:12345-0@lo:400:kworker.0 Request processed in 405us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614226.743651:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787614226.743671:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787614226.743707:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692288768:0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.743733:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1874448692289280:0@lo:400:kworker.0 00000100:00100000:3.0:1787614226.743758:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1874448692289792:0@lo:400:kworker.0 00000100:00100000:1.0:1787614226.747881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614226.747963:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1874448692289664:0@lo:400:kworker.0 00000100:00100000:1.0:1787614226.748539:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614226.748565:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692290176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787614226.748592:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614226.748742:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692290176 00000100:00100000:1.0:1787614226.748751:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692290176 00000100:00100000:0.0:1787614226.748855:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289664 00000100:00100000:0.0:1787614226.748860:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289664 00000100:00100000:0.0:1787614226.748932:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787614226.748941:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874448692289664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614226.749539:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787614226.749547:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692290176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787614226.749568:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787614226.750251:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692289152 00000100:00100000:3.0:1787614226.750261:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692289152 00000100:00100000:3.0:1787614226.750311:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787614226.750320:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692289152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614226.754985:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3636:x1874448692288640:12345-0@lo:400:kworker.0 Request processed in 12028us (12257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614226.755015:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1787614226.755256:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787614226.755264:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787614226.756655:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3636:1874448692288640:0@lo:400:kworker.0 00000100:00100000:0.0:1787614226.761985:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874448692289664:12345-0@lo:400:kworker.0 Request processed in 13032us (13434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614226.762015:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787614226.762448:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5e76369c00 x1874448692289664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787614226.762467:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1874448692289664:0@lo:400:kworker.0 00000100:00100000:1.0:1787614226.763610:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692290176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14048us (15001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614226.763624:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787614226.764088:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692290176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787614226.764313:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692289152:12345-0@lo:400:kworker.0 Request processed in 13991us (16439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614226.764325:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787614226.764497:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692289152:0@lo:400:kworker.0 00010000:00010000:3.0:1787614227.315849:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614227.883859:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.883906:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.883945:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.883985:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614227.884152:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204736 00000100:00100000:2.0:1787614227.884192:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204736 00000100:00100000:2.0:1787614227.884273:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:2.0:1787614227.884286:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671204736:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:2.0:1787614227.884384:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671204736:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 100us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614227.884392:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00080000:2.0:1787614227.884417:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787614227.884634:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.884658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.884678:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.884699:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614227.884721:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614227.884838:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204480 00000100:00100000:1.0:1787614227.884845:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204480 00000100:00100000:1.0:1787614227.884886:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 146 00000100:00100000:1.0:1787614227.884895:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:2400:x1874448671204480:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.884940:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:2400:x1874448671204480:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 46us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.884947:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 146 00000100:00100000:1.0:1787614227.885054:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205248 00000100:00100000:1.0:1787614227.885059:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205248 00000100:00100000:1.0:1787614227.885091:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204608 00000100:00100000:1.0:1787614227.885095:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204608 00000100:00100000:1.0:1787614227.885109:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205120 00000100:00100000:1.0:1787614227.885112:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205120 00000100:00100000:1.0:1787614227.885127:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1787614227.885148:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2400:x1874448671205248:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.885211:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2400:x1874448671205248:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 65us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.885219:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1787614227.885234:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:1.0:1787614227.885240:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2400:x1874448671204608:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.885268:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2400:x1874448671204608:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.885275:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:1.0:1787614227.885288:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:1.0:1787614227.885294:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2400:x1874448671205120:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.885320:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2400:x1874448671205120:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.885327:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:1.0:1787614227.885348:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204992 00000100:00100000:1.0:1787614227.885353:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204992 00000100:00100000:1.0:1787614227.885384:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205504 00000100:00100000:1.0:1787614227.885387:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205504 00000100:00100000:1.0:1787614227.885405:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671204864 00000100:00100000:1.0:1787614227.885408:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671204864 00000100:00100000:1.0:1787614227.885425:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:1.0:1787614227.885431:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671204992:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.885458:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671204992:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 28us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.885465:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:1.0:1787614227.885485:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:1.0:1787614227.885492:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2400:x1874448671205504:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.885519:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2400:x1874448671205504:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 28us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.885524:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:1.0:1787614227.885536:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:1.0:1787614227.885542:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671204864:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614227.885565:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671204864:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 24us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614227.885572:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00080000:1.0:1787614227.885713:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787614227.885717:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787614227.885720:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787614227.885722:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787614227.888657:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205376 00000100:00100000:3.0:1787614227.888678:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205376 00000100:00100000:3.0:1787614227.888803:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1787614227.888816:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2400:x1874448671205376:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614227.888942:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2400:x1874448671205376:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 128us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614227.888953:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00080000:2.0:1787614227.889147:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787614227.889862:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787614228.342788:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614229.362578:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614229.811019:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614229.811043:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692290304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787614229.811114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614229.811240:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692290304 00000100:00100000:2.0:1787614229.811249:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692290304 00000100:00100000:2.0:1787614229.811315:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787614229.811325:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692290304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787614229.811353:0:24167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787614229.811403:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692290304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614229.811410:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787614229.811454:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692290304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787614229.811621:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787614230.278530:0:25684:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb562d8d0 20000000:00000080:1.0:1787614230.278549:0:25684:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b5e7d222c00 uarg=0000000000000000 20000000:01000000:1.0:1787614230.278677:0:25684:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787614230.278684:0:25684:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787614230.278689:0:25684:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787614230.279045:0:25685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787614230.279205:0:25684:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787614230.297452:0:25684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787614230.297773:0:25684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297792:0:25684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297818:0:25684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297824:0:25684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297831:0:25684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297839:0:25684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297845:0:25684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297852:0:25684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297895:0:25684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.297909:0:25684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.297922:0:25684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290432:192.168.206.55@tcp:104: 00010000:00010000:2.0:1787614230.298021:0:25684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.298030:0:25684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298047:0:25684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67192d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290560:192.168.206.55@tcp:104: 00010000:00010000:2.0:1787614230.298082:0:25684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.298089:0:25684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 23 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298098:0:25684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290688:0@lo:104: 00000100:00100000:2.0:1787614230.298134:0:25684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787614230.298221:0:25684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.298231:0:25684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 23 pid: 22650 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298251:0:25684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67193b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290816:0@lo:104: 00000100:00100000:2.0:1787614230.298276:0:25684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614230.298365:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692290688 00000100:00100000:0.0:1787614230.298373:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692290688 00010000:00010000:2.0:1787614230.298385:0:25684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.298395:0:25684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 23 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298405:0:25684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290944:0@lo:104: 00000100:00100000:0.0:1787614230.298427:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692290816 00000100:00100000:0.0:1787614230.298432:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692290816 00000100:00100000:2.0:1787614230.298433:0:25684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614230.298449:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692290944 00000100:00100000:0.0:1787614230.298453:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692290944 00010000:00010000:2.0:1787614230.298458:0:25684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614230.298470:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787614230.298482:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:25684:x1874448692290688:12345-0@lo:104: 00010000:00010000:2.0:1787614230.298485:0:25684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 23 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298500:0:25684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d422b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692291072:0@lo:104: 00010000:00010000:0.0:1787614230.298501:0:22639:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298531:0:25684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614230.298546:0:25684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e67a1d9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787614230.298569:0:22639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787614230.298571:0:25684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290688:0@lo:104: 00000100:00100000:0.0:1787614230.298580:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:25684:x1874448692290688:12345-0@lo:104: Request processed in 99us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.298588:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787614230.298605:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291072 00000100:00100000:0.0:1787614230.298609:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291072 00000100:00100000:0.0:1787614230.298622:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614230.298627:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:25684:x1874448692290816:12345-0@lo:104: 00010000:00010000:0.0:1787614230.298635:0:22639:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.298679:0:22639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787614230.298689:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+5:25684:x1874448692290816:12345-0@lo:104: Request processed in 61us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.298696:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614230.298711:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787614230.298718:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:25684:x1874448692290944:12345-0@lo:104: 00010000:00010000:0.0:1787614230.298726:0:22639:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.298731:0:25684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67193b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290816:0@lo:104: 00010000:00010000:0.0:1787614230.298785:0:22639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787614230.298790:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+4:25684:x1874448692290944:12345-0@lo:104: Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.298796:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787614230.298807:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787614230.298812:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:25684:x1874448692291072:12345-0@lo:104: 00010000:00010000:0.0:1787614230.298819:0:22639:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.298854:0:22639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787614230.298858:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+3:25684:x1874448692291072:12345-0@lo:104: Request processed in 47us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.298864:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787614230.298891:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787614230.298896:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.298903:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99e00 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:0.0:1787614230.298906:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.298923:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787614230.298930:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614230.298936:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787614230.298963:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.298969:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787614230.298986:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.298992:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99e00/0x9719586bc2ef0a3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef0a43 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299001:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787614230.299004:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299009:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e41669000 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:0.0:1787614230.299012:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299018:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787614230.299024:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614230.299035:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787614230.299047:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299052:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787614230.299065:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299070:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e41669000/0x9719586bc2ef09a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef09a9 expref: -99 pid: 24158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299089:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787614230.299092:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299097:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7af99800 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:0.0:1787614230.299100:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299105:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787614230.299111:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614230.299115:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787614230.299126:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299131:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787614230.299142:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299148:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7af99800/0x9719586bc2ef0963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef096a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299178:0:22644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787614230.299181:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299187:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7f6f0400 already unused, calling callback (ffffffffc149bc20) 10000000:00010000:0.0:1787614230.299190:0:22644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299196:0:22644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787614230.299202:0:22644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614230.299207:0:22644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787614230.299219:0:22644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299225:0:22644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787614230.299230:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299236:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: ffff8b5e7f6f0400/0x9719586bc2ef0955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9719586bc2ef095c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299260:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614230.299261:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614230.299263:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787614230.299270:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614230.299288:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692291200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.299319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614230.299348:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787614230.299353:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692291584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.299375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614230.299408:0:25684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290944:0@lo:104: 00000100:00100000:0.0:1787614230.299408:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e76369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692291328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787614230.299425:0:25684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d422b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692291072:0@lo:104: 00000100:00100000:0.0:1787614230.299452:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614230.299479:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787614230.299485:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692291456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.299513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614230.299539:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291200 00000100:00100000:0.0:1787614230.299543:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291200 00010000:00010000:0.0:1787614230.299564:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 24 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614230.299578:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291584 00000100:00100000:0.0:1787614230.299581:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291584 00010000:00010000:0.0:1787614230.299588:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 25 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614230.299597:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291328 00000100:00100000:0.0:1787614230.299600:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291328 00010000:00010000:0.0:1787614230.299608:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 26 pid: 22650 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614230.299630:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291456 00000100:00100000:0.0:1787614230.299633:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291456 00010000:00010000:0.0:1787614230.299644:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 27 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614230.299655:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787614230.299660:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+27:3638:x1874448692291200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787614230.299669:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614230.299674:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 27 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299682:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 27 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299694:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e7f6f0000/0x9719586bc2ef0a43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef0a3c expref: 27 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299706:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614230.299734:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+26:3638:x1874448692291200:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.299741:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787614230.299755:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614230.299775:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+25:3638:x1874448692291584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787614230.299782:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614230.299787:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 25 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299795:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 25 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299812:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669e00/0x9719586bc2ef095c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef0955 expref: 25 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299821:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614230.299844:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:3638:x1874448692291584:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.299850:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787614230.299862:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787614230.299867:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:3635:x1874448692291328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787614230.299873:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614230.299878:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 23 pid: 22650 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299885:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 23 pid: 22650 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299894:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669a00/0x9719586bc2ef09a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef09a2 expref: 23 pid: 22650 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299901:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614230.299925:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:3635:x1874448692291328:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.299931:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787614230.299943:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787614230.299949:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:3635:x1874448692291456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787614230.299956:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614230.299960:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 21 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299974:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 21 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299984:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e41669400/0x9719586bc2ef096a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9719586bc2ef0963 expref: 21 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614230.299993:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614230.300016:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:3635:x1874448692291456:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614230.300022:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787614230.300054:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692291584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.300063:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692291200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.300089:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692291456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.300096:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e76369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3635:1874448692291328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787614230.305285:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614230.305377:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205632 00000100:00100000:1.0:1787614230.305386:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205632 00010000:00010000:1.0:1787614230.305432:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 13 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614230.305469:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 13 00000100:00100000:1.0:1787614230.305479:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7af28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:2401:x1874448671205632:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787614230.305493:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614230.305498:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 13 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614230.305510:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 13 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614230.305529:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614230.305584:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7af28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:2401:x1874448671205632:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 105us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614230.305590:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 13 00010000:00010000:2.0:1787614230.305626:0:25684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292441f3 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.305644:0:25684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290432:192.168.206.55@tcp:104: 00000100:00100000:2.0:1787614230.305658:0:25684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67192d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25684:1874448692290560:192.168.206.55@tcp:104: 00010000:00010000:2.0:1787614230.305691:0:25684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614230.310860:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614230.311240:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205760 00000100:00100000:2.0:1787614230.311251:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205760 00010000:00010000:2.0:1787614230.311414:0:22642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.311449:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 14 00000100:00100000:2.0:1787614230.311459:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:2400:x1874448671205760:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787614230.311491:0:22642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614230.311499:0:22642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311513:0:22642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311532:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5d43b38c00/0x9719586bc2ef0c8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244183 expref: 12 pid: 22649 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311551:0:22642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311570:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311588:0:22642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311773:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311779:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311786:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311791:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719c00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614230.311795:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311814:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311832:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614230.311841:0:22642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787614230.312055:0:25684:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614230.312063:0:25684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614230.312069:0:25684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5e51719c00/0x9719586bc2ef0cff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614230.314486:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:2400:x1874448671205760:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 3019us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614230.314501:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 14 00010000:00010000:0.0:1787614230.388751:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787614231.345498:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787614231.345521:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692291712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787614231.345584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.345725:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291712 00000100:00100000:0.0:1787614231.345733:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291712 00000100:00100000:0.0:1787614231.345791:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787614231.345801:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d422b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692291712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787614231.345835:0:23398:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787614231.345890:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d422b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692291712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614231.345897:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787614231.346030:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692291712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787614231.346182:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787614231.346192:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692291840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787614231.346223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614231.346291:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692291840 00000100:00100000:1.0:1787614231.346295:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692291840 00000100:00100000:1.0:1787614231.346333:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787614231.346341:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692291840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787614231.346360:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787614231.346406:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692291840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.346412:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787614231.346517:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692291840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787614231.409433:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614231.526488:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.526652:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671205888 00000100:00100000:2.0:1787614231.526662:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671205888 00000100:00100000:2.0:1787614231.526726:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 147 00000100:00100000:2.0:1787614231.526737:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+11:18051:x1874448671205888:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614231.526762:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614231.526781:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51718e00/0x9719586bc2ef0d06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f97702924422b expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.526808:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51718e00/0x9719586bc2ef0d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924422b expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.526838:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51718e00/0x9719586bc2ef0d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924422b expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.526847:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51718e00, rc 0) 00000100:00100000:2.0:1787614231.526905:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18051:x1874448671205888:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 170us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.526912:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 147 00000100:00100000:0.0:1787614231.536430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.536545:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206016 00000100:00100000:1.0:1787614231.536555:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206016 00000100:00100000:1.0:1787614231.536615:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 148 00000100:00100000:1.0:1787614231.537883:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18051:x1874448671206016:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787614231.538055:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18051:x1874448671206016:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 185us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.538065:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 148 00000100:00100000:0.0:1787614231.541736:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.542003:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206144 00000100:00100000:1.0:1787614231.542012:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206144 00000100:00100000:1.0:1787614231.542069:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 149 00000100:00100000:1.0:1787614231.542079:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18051:x1874448671206144:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787614231.542252:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18051:x1874448671206144:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 174us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.542262:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 149 00000100:00100000:0.0:1787614231.547264:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.547375:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206272 00000100:00100000:2.0:1787614231.547384:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206272 00000100:00100000:2.0:1787614231.547436:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 150 00000100:00100000:2.0:1787614231.547446:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+12:18051:x1874448671206272:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614231.547461:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614231.547477:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51719000/0x9719586bc2ef0d0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf43f977029244232 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.547502:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51719000/0x9719586bc2ef0d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244232 expref: 13 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.547513:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51719000/0x9719586bc2ef0d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244232 expref: 13 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.547523:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51719000, rc 0) 00000100:00100000:2.0:1787614231.547576:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18051:x1874448671206272:12345-192.168.206.55@tcp:101:ll_cfg_requeue.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.547594:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 150 00000100:00100000:0.0:1787614231.553597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614231.553731:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206400 00000100:00100000:3.0:1787614231.553741:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206400 00000100:00100000:3.0:1787614231.553811:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 151 00000100:00100000:3.0:1787614231.553821:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18051:x1874448671206400:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787614231.553966:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18051:x1874448671206400:12345-192.168.206.55@tcp:501:ll_cfg_requeue.0 Request processed in 145us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.553974:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 151 00000100:00100000:0.0:1787614231.556066:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.556154:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206528 00000100:00100000:1.0:1787614231.556187:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206528 00000100:00100000:1.0:1787614231.556237:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 152 00000100:00100000:1.0:1787614231.556247:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18051:x1874448671206528:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787614231.556397:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4323b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:18051:x1874448671206528:12345-192.168.206.55@tcp:503:ll_cfg_requeue.0 Request processed in 149us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.556405:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 152 00000100:00100000:0.0:1787614231.643869:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.643965:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206656 00000100:00100000:1.0:1787614231.643976:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206656 00000100:00100000:1.0:1787614231.644059:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:1.0:1787614231.644072:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+6:18673:x1874448671206656:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787614231.644092:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614231.644112:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0d14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244239 expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644224:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644239:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644249:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644263:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644269:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644275:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787614231.644456:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787614231.644897:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0d29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644907:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0d29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.644915:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0d29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614231.644945:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787614231.644948:0:24946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614231.644987:0:24946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0d29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645008:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645014:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645021:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645028:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152800 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614231.645032:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645040:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645052:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:1.0:1787614231.645054:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.645059:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645065:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645079:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645085:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645089:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645100:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614231.645103:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645109:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645117:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8b5e5958e400) 00010000:00010000:1.0:1787614231.645119:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.645122:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645127:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645241:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0d14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244239 expref: 8 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645256:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152400/0x9719586bc2ef0d29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244239 expref: 7 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.645263:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5e5958ed00) 00010000:00010000:1.0:1787614231.645266:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787614231.645268:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d152400, rc 0) 00000100:00100000:1.0:1787614231.645345:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18673:x1874448671206656:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1276us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.645354:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:0.0:1787614231.650257:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.650527:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671206784 00000100:00100000:2.0:1787614231.650537:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671206784 00000100:00100000:2.0:1787614231.650672:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:2.0:1787614231.650684:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18673:x1874448671206784:12345-192.168.206.55@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787614231.651867:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18673:x1874448671206784:12345-192.168.206.55@tcp:900:lhsmtool_posix.0 Request processed in 1177us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.651878:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:0.0:1787614231.672345:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.673691:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207040 00000100:00100000:2.0:1787614231.673705:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207040 00000100:00100000:2.0:1787614231.673783:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:2.0:1787614231.673794:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18673:x1874448671207040:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787614231.673815:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614231.673839:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244240 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.673938:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.673955:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.673970:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.673984:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.673991:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.674016:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.674126:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718600/0x9719586bc2ef0d45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.674134:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718600/0x9719586bc2ef0d45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.674141:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718600/0x9719586bc2ef0d45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787614231.674149:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787614231.675014:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675025:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675032:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675037:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51718c00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614231.675041:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675048:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675061:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5e5958ed00) 00010000:00010000:2.0:1787614231.675064:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614231.675076:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675082:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0d37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675096:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675102:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675107:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675112:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51718400 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614231.675115:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675120:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675127:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b5d4312df00) 00010000:00010000:2.0:1787614231.675130:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614231.675132:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.675137:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.678337:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244240 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.678383:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718600/0x9719586bc2ef0d45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244240 expref: 9 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.678393:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5d4312d600) 00010000:00010000:2.0:1787614231.678396:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614231.678398:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51718600, rc 0) 00000100:00100000:2.0:1787614231.678461:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18673:x1874448671207040:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 4668us (6125us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787614231.678470:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:3.0:1787614231.686342:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.686540:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207168 00000100:00100000:1.0:1787614231.686563:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207168 00000100:00100000:1.0:1787614231.686639:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:1.0:1787614231.686650:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18673:x1874448671207168:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787614231.686943:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18673:x1874448671207168:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 Request processed in 295us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.686951:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:0.0:1787614231.692255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.692350:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207296 00000100:00100000:2.0:1787614231.692361:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207296 00000100:00100000:2.0:1787614231.692436:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:2.0:1787614231.692448:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:18673:x1874448671207296:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787614231.693830:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787614231.695815:0:22656:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3327us 00000100:00100000:1.0:1787614231.718324:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:18673:x1874448671207296:12345-192.168.206.55@tcp:59:lhsmtool_posix.0 Request processed in 25867us (26066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.718341:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:0.0:1787614231.727564:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.727654:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207424 00000100:00100000:1.0:1787614231.727664:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207424 00000100:00100000:1.0:1787614231.727721:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:1.0:1787614231.727732:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18679:x1874448671207424:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1787614231.727762:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614231.727782:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0d53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244247 expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727843:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727858:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727869:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727883:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727905:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727912:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727947:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727954:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727960:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727965:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614231.727969:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727976:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.727987:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:1.0:1787614231.727990:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.727995:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728001:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728013:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728024:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728030:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728035:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152800 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614231.728037:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728043:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728050:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8b5e5958e400) 00010000:00010000:1.0:1787614231.728053:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.728055:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728061:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728092:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0d53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244247 expref: 10 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728101:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:1.0:1787614231.728103:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.728107:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0d53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244247 expref: 10 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.728126:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153400, rc 0) 00000100:00100000:1.0:1787614231.728214:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18679:x1874448671207424:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 483us (669us total) trans 0 rc 301/301 00000100:00100000:1.0:1787614231.728220:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:3.0:1787614231.732876:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.733015:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207552 00000100:00100000:1.0:1787614231.733025:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207552 00000100:00100000:1.0:1787614231.733078:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:1.0:1787614231.733089:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18679:x1874448671207552:12345-192.168.206.55@tcp:700:lfs.0 00000100:00100000:1.0:1787614231.733194:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18679:x1874448671207552:12345-192.168.206.55@tcp:700:lfs.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.733203:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:0.0:1787614231.735638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614231.735711:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207808 00000100:00100000:3.0:1787614231.735720:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207808 00000100:00100000:3.0:1787614231.735787:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:3.0:1787614231.735797:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+9:18679:x1874448671207808:12345-192.168.206.55@tcp:36:lfs.0 00010000:00010000:3.0:1787614231.735849:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614231.735888:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0cb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292441b4 expref: 9 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.735906:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:3.0:1787614231.735910:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787614231.735969:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.735983:0:22655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 5 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.736009:0:22655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.736042:0:22655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 5 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.736055:0:22655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 5 pid: 22655 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614231.736068:0:22655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22655:1874448692291968:192.168.206.55@tcp:104: 00000100:00100000:3.0:1787614231.736150:0:22655:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e70a280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614231.739322:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.739469:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671207936 00000100:00100000:0.0:1787614231.739478:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671207936 00010000:00010000:0.0:1787614231.739527:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 6 pid: 22655 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614231.739571:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00100000:0.0:1787614231.739581:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2401:x1874448671207936:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787614231.739593:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614231.739600:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 6 pid: 22655 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.739612:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 6 pid: 22655 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.739653:0:22640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:0.0:1787614231.739658:0:22640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.739666:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.739673:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.739690:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614231.739741:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:2401:x1874448671207936:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 160us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614231.739749:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 15 00000100:00080000:1.0:1787614231.740241:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787614231.740636:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0cf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244224 expref: 5 pid: 22655 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614231.740656:0:22655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22655:1874448692291968:192.168.206.55@tcp:104: 00010000:00010000:2.0:1787614231.740675:0:22655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.740683:0:22655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.740689:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.740728:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.740739:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.740748:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742131:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742146:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742344:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787614231.742365:0:22655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a7959e9 reply state 00000000ac70c500 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742377:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742384:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:2.0:1787614231.742387:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787614231.742391:0:22655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787614231.742397:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787614231.742404:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742411:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742424:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742430:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614231.742434:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742441:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742451:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5d43185b00) 00010000:00010000:2.0:1787614231.742454:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614231.742457:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742464:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0d68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787614231.742483:0:22655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a7959e9 reply state 00000000ac70c500 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742492:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.742498:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8b5d4312df00) 00010000:00010000:2.0:1787614231.742500:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787614231.742502:0:22655:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787614231.742884:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+10:18679:x1874448671207808:12345-192.168.206.55@tcp:36:lfs.0 Request processed in 7086us (7251us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787614231.742893:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 28 00000100:00100000:3.0:1787614231.829247:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.829373:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671208064 00000100:00100000:1.0:1787614231.829383:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671208064 00000100:00100000:1.0:1787614231.829437:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:1.0:1787614231.829447:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+10:18687:x1874448671208064:12345-192.168.206.55@tcp:101:lctl.0 00010000:00010000:1.0:1787614231.829470:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614231.829492:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f97702924424e expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.829576:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.829590:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.829623:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614231.829669:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787614231.829673:0:24946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614231.829709:0:24946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.829735:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924424e expref: 12 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.829766:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152000/0x9719586bc2ef0d84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924424e expref: 11 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.829775:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:1.0:1787614231.829778:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787614231.829781:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d152000, rc 0) 00000100:00100000:1.0:1787614231.831153:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+11:18687:x1874448671208064:12345-192.168.206.55@tcp:101:lctl.0 Request processed in 1698us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.831179:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 29 00000100:00100000:1.0:1787614231.856140:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.856572:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671208192 00000100:00100000:0.0:1787614231.856582:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671208192 00000100:00100000:0.0:1787614231.856643:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:0.0:1787614231.856654:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:18688:x1874448671208192:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1787614231.856674:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614231.856696:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0d8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244255 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.856768:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045600/0x9719586bc2ef0d92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.856781:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045600/0x9719586bc2ef0d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.856789:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045600/0x9719586bc2ef0d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787614231.856849:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787614231.856853:0:22656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787614231.856889:0:22656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045600/0x9719586bc2ef0d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.856914:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0d8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244255 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.856932:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045600/0x9719586bc2ef0d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244255 expref: 6 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.856940:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:0.0:1787614231.856943:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787614231.856946:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82045600, rc 0) 00000100:00100000:0.0:1787614231.857010:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18688:x1874448671208192:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 357us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614231.857017:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 30 00000100:00100000:2.0:1787614231.857656:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787614231.857673:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e67191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692292096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787614231.857718:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614231.857765:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292096 00000100:00100000:2.0:1787614231.857770:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292096 00000100:00100000:2.0:1787614231.857814:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787614231.857822:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692292096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787614231.857844:0:24167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787614231.857895:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874448692292096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.857902:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787614231.857922:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787614231.857953:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e67191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1874448692292096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787614231.858057:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787614231.858068:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692292224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787614231.858097:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.858852:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692292352:0@lo:400:kworker.0 00000100:00100000:0.0:1787614231.858952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.858978:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692292864:0@lo:400:kworker.0 00000100:00100000:0.0:1787614231.859005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.859021:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1874448692293376:0@lo:400:kworker.0 00000100:00100000:0.0:1787614231.859042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.859062:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787614231.859067:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874448692292736:0@lo:400:kworker.0 00000100:00100000:0.0:1787614231.859088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.859116:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692293248:0@lo:400:kworker.0 00000100:00100000:0.0:1787614231.859137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614231.859184:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692293376 00000100:00100000:0.0:1787614231.859190:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692293376 00000100:00100000:0.0:1787614231.859223:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292736 00000100:00100000:0.0:1787614231.859226:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292736 00000100:00100000:0.0:1787614231.859235:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692293248 00000100:00100000:0.0:1787614231.859237:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692293248 00000100:00100000:0.0:1787614231.859250:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787614231.859257:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874448692293376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614231.859499:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787614231.859508:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874448692292736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614231.859564:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874448692292736:12345-0@lo:400:kworker.0 Request processed in 58us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.859579:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787614231.859597:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787614231.859603:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692293248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787614231.859632:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874448692293248:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.859637:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787614231.859699:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874448692292736:0@lo:400:kworker.0 00000100:00100000:1.0:1787614231.859710:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1874448692293248:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.859937:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692292608:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.859972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860007:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692293120:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860029:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860048:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692293632:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860069:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860089:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787614231.860094:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692292480:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860134:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692292992:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860152:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860208:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1874448692293504:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860392:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292608 00000100:00100000:3.0:1787614231.860398:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292608 00000100:00100000:3.0:1787614231.860432:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292992 00000100:00100000:3.0:1787614231.860436:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292992 00000100:00100000:3.0:1787614231.860458:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787614231.860466:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692292608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860508:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692292608:12345-0@lo:400:kworker.0 Request processed in 43us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.860514:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787614231.860528:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787614231.860534:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692292992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860564:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692292992:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.860570:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787614231.860588:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292864 00000100:00100000:3.0:1787614231.860592:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292864 00000100:00100000:3.0:1787614231.860613:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292480 00000100:00100000:3.0:1787614231.860616:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292480 00000100:00100000:3.0:1787614231.860628:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787614231.860634:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e76369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692292864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860669:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692292864:12345-0@lo:400:kworker.0 Request processed in 34us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.860675:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787614231.860687:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787614231.860693:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692292480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860735:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874448692292480:12345-0@lo:400:kworker.0 Request processed in 42us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.860741:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787614231.860791:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692292480:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860802:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692292992:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860811:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1874448692292608:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860842:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692292864:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860850:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787614231.860859:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692293760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787614231.860883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614231.860910:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692293120 00000100:00100000:3.0:1787614231.860914:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692293120 00000100:00100000:3.0:1787614231.860930:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692293632 00000100:00100000:3.0:1787614231.860932:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692293632 00000100:00100000:3.0:1787614231.860943:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692293504 00000100:00100000:3.0:1787614231.860946:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692293504 00000100:00100000:3.0:1787614231.860958:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787614231.860964:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692293120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.860999:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874448692293120:12345-0@lo:400:kworker.0 Request processed in 35us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.861005:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787614231.861017:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787614231.861022:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874448692293632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.861051:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874448692293632:12345-0@lo:400:kworker.0 Request processed in 29us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.861067:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787614231.861078:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787614231.861084:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874448692293504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.861116:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874448692293504:12345-0@lo:400:kworker.0 Request processed in 32us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.861122:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787614231.861147:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1874448692293504:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.861183:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874448692293120:0@lo:400:kworker.0 00010000:00080000:3.0:1787614231.861198:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5d43837b80 x1874448692293632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614231.861209:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1874448692293632:0@lo:400:kworker.0 00000100:00100000:0.0:1787614231.861847:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e76368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874448692293376:12345-0@lo:400:kworker.0 Request processed in 2587us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614231.861857:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787614231.861953:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292352 00000100:00100000:2.0:1787614231.861959:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292352 00000100:00100000:2.0:1787614231.861989:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787614231.861996:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:3638:x1874448692292352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787614231.862039:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:3638:x1874448692292352:12345-0@lo:400:kworker.0 Request processed in 44us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.862045:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787614231.862084:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692292224 00000100:00100000:2.0:1787614231.862088:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692292224 00000100:00100000:2.0:1787614231.862109:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692293760 00000100:00100000:2.0:1787614231.862112:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692293760 00000100:00100000:2.0:1787614231.862122:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787614231.862128:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692292224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787614231.862149:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787614231.862224:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874448692292224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.862230:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787614231.862241:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787614231.862246:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692293760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787614231.862256:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787614231.862292:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692293760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.862298:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787614231.862314:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787614231.862318:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787614231.862320:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787614231.862323:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787614231.862722:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692293760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787614231.862735:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:3638:1874448692292352:0@lo:400:kworker.0 00010000:00080000:3.0:1787614231.862747:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8b5d43836680 x1874448692293376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787614247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787614231.862772:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1874448692293376:0@lo:400:kworker.0 00000100:00100000:3.0:1787614231.862788:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1874448692292224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787614231.867381:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614231.867512:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671208320 00000100:00100000:3.0:1787614231.867522:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671208320 00000100:00100000:3.0:1787614231.867593:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:3.0:1787614231.867604:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+6:18688:x1874448671208320:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1787614231.867639:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614231.867659:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f97702924425c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867723:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867736:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867747:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867772:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867780:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867788:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867861:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef0dae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867869:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef0dae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867876:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef0dae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787614231.867912:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787614231.867921:0:22656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787614231.867945:0:22656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef0dae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867958:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867963:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867970:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867976:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b39200 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614231.867981:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867987:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.867999:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:3.0:1787614231.868002:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614231.868006:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868012:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b39200/0x9719586bc2ef0da0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868026:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868033:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868049:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868054:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614231.868057:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868064:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868073:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8b5d4312df00) 00010000:00010000:3.0:1787614231.868075:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614231.868078:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868083:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0da7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868108:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924425c expref: 8 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868122:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef0dae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924425c expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.868129:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:3.0:1787614231.868131:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787614231.868134:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38c00, rc 0) 00000100:00100000:3.0:1787614231.868253:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+7:18688:x1874448671208320:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 651us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.868279:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 31 00000100:00100000:3.0:1787614231.872707:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.872805:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671208448 00000100:00100000:0.0:1787614231.872815:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671208448 00000100:00100000:0.0:1787614231.872899:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:0.0:1787614231.872909:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:18688:x1874448671208448:12345-192.168.206.55@tcp:900:lfs.0 00000100:00100000:0.0:1787614231.872992:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:18688:x1874448671208448:12345-192.168.206.55@tcp:900:lfs.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614231.873000:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00080000:2.0:1787614231.873984:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787614231.879076:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.879206:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671208704 00000100:00100000:0.0:1787614231.879215:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671208704 00000100:00100000:0.0:1787614231.879288:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:0.0:1787614231.879299:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+7:18688:x1874448671208704:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1787614231.879320:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614231.879346:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244263 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787614231.879471:0:22657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787614231.879582:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0db5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244263 expref: 9 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.879597:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:0.0:1787614231.879601:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787614231.879605:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244263 expref: 9 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.879619:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82044200, rc 0) 00000100:00100000:0.0:1787614231.879680:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+8:18688:x1874448671208704:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 383us (613us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1787614231.879688:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 32 00000100:00100000:3.0:1787614231.887261:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.887454:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671208960 00000100:00100000:1.0:1787614231.887464:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671208960 00000100:00100000:1.0:1787614231.887522:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:1.0:1787614231.887532:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+8:18688:x1874448671208960:12345-192.168.206.55@tcp:36:lfs.0 00010000:00010000:1.0:1787614231.887615:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614231.887641:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38c00/0x9719586bc2ef0dae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924425c expref: 8 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.887661:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:1.0:1787614231.887665:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787614231.887689:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.887701:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.887711:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787614231.887923:0:22656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb2d8aff reply state 000000008af67484 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.887937:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.887944:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:1.0:1787614231.887946:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787614231.887949:0:22656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787614231.887957:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787614231.888138:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+9:18688:x1874448671208960:12345-192.168.206.55@tcp:36:lfs.0 Request processed in 606us (885us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787614231.888146:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 33 00000100:00100000:3.0:1787614231.891627:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.892027:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671209216 00000100:00100000:2.0:1787614231.892037:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671209216 00000100:00100000:2.0:1787614231.892100:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:2.0:1787614231.892111:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+9:18688:x1874448671209216:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:2.0:1787614231.892370:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+10:18688:x1874448671209216:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 260us (752us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787614231.892378:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:2.0:1787614231.900077:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.900204:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671209472 00000100:00100000:0.0:1787614231.900214:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671209472 00000100:00100000:0.0:1787614231.900272:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:0.0:1787614231.900291:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e67191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+10:18688:x1874448671209472:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1787614231.900315:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614231.900336:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0dca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f97702924426a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900408:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900422:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900462:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900476:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900483:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900489:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787614231.900590:0:22657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787614231.900656:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900664:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900670:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900676:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045800 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:0.0:1787614231.900680:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900688:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900700:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:0.0:1787614231.900703:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787614231.900713:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900719:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045800/0x9719586bc2ef0dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900734:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900740:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900745:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900763:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044600 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:0.0:1787614231.900766:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900771:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900779:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8b5d4312df00) 00010000:00010000:0.0:1787614231.900782:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787614231.900784:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900789:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044600/0x9719586bc2ef0dd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900823:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0dca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924426a expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900844:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:0.0:1787614231.900847:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787614231.900851:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0dca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924426a expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614231.900861:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82044200, rc 0) 00000100:00100000:0.0:1787614231.900933:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e67191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+11:18688:x1874448671209472:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 644us (865us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787614231.900941:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 34 00000100:00100000:3.0:1787614231.904417:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.904519:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671209600 00000100:00100000:1.0:1787614231.904530:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671209600 00000100:00100000:1.0:1787614231.904589:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:1.0:1787614231.904599:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+11:18688:x1874448671209600:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:1.0:1787614231.904623:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614231.904644:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0de6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244271 expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.904735:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.904761:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.904773:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614231.904815:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787614231.904818:0:24946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614231.904837:0:24946:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.904875:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0de6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 13 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.904894:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 12 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.904902:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:1.0:1787614231.904905:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787614231.904908:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153c00, rc 0) 00000100:00100000:1.0:1787614231.904972:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:18688:x1874448671209600:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 374us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.904979:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 35 00000100:00100000:3.0:1787614231.919692:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.919796:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671209728 00000100:00100000:2.0:1787614231.919805:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671209728 00000100:00100000:2.0:1787614231.919859:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:2.0:1787614231.919877:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:18688:x1874448671209728:12345-192.168.206.55@tcp:37:lfs.0 00000100:00100000:3.0:1787614231.926636:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:18688:x1874448671209728:12345-192.168.206.55@tcp:37:lfs.0 Request processed in 6749us (6942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614231.926649:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 3 00000100:00100000:3.0:1787614231.929713:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.929820:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671209984 00000100:00100000:0.0:1787614231.929829:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671209984 00000100:00100000:0.0:1787614231.930355:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:0.0:1787614231.930371:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4388dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:18688:x1874448671209984:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1787614231.930777:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4388dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:519f82bc-988d-4bf1-a38f-1e4913fb5c38+13:18688:x1874448671209984:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 410us (1073us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787614231.930786:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 4 00000100:00100000:0.0:1787614231.973818:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614231.974104:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671210112 00000100:00100000:2.0:1787614231.974114:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671210112 00000100:00100000:2.0:1787614231.974210:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:2.0:1787614231.974221:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+11:18694:x1874448671210112:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1787614231.974243:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614231.974263:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244278 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974540:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974556:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974567:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974578:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974605:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974613:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974692:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153a00/0x9719586bc2ef0e09 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974702:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153a00/0x9719586bc2ef0e09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974710:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153a00/0x9719586bc2ef0e09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614231.974743:0:22657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787614231.974747:0:22657:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614231.974800:0:22657:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153a00/0x9719586bc2ef0e09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974813:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974820:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974827:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974833:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152a00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614231.974837:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.974850:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975086:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:1.0:1787614231.975091:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.975096:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975103:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0dfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975119:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975125:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975130:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975135:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152e00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614231.975138:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975144:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975153:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8b5d4312df00) 00010000:00010000:1.0:1787614231.975155:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614231.975209:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975226:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0e02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975259:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244278 expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975422:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153a00/0x9719586bc2ef0e09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244278 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.975431:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:1.0:1787614231.975434:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787614231.975436:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153a00, rc 0) 00000100:00100000:1.0:1787614231.975506:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+12:18694:x1874448671210112:12345-192.168.206.55@tcp:101:bash.0 Request processed in 1287us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614231.975515:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 36 00000100:00100000:2.0:1787614231.978442:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614231.978542:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671210240 00000100:00100000:0.0:1787614231.978562:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671210240 00000100:00100000:0.0:1787614231.978651:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1787614231.978662:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:18694:x1874448671210240:12345-192.168.206.55@tcp:900:bash.0 00000100:00100000:0.0:1787614231.978743:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:18694:x1874448671210240:12345-192.168.206.55@tcp:900:bash.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614231.978760:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:3.0:1787614231.981069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.981299:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671210496 00000100:00100000:1.0:1787614231.981309:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671210496 00000100:00100000:1.0:1787614231.981360:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 37 00000100:00100000:1.0:1787614231.981369:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+12:18694:x1874448671210496:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:1.0:1787614231.981388:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614231.981405:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0e10 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f97702924427f expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.981498:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.981512:0:24946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 12 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.981533:0:24946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.981575:0:24946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 12 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614231.981588:0:24946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 12 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614231.981600:0:24946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24946:1874448692293888:192.168.206.55@tcp:104: 00000100:00100000:1.0:1787614231.981674:0:24946:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d42269900 going to sleep for 11 seconds 00000100:00100000:3.0:1787614231.984190:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614231.984317:0:24946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43b86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24946:1874448692293888:192.168.206.55@tcp:104: 00010000:00010000:1.0:1787614231.984341:0:24946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614231.984449:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671210624 00000100:00100000:2.0:1787614231.984456:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671210624 00010000:00010000:2.0:1787614231.984490:0:22642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 13 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614231.984528:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 16 00000100:00100000:2.0:1787614231.984537:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+13:2400:x1874448671210624:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787614231.984549:0:22642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614231.984555:0:22642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 13 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.984568:0:22642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 13 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.984586:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0ded lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244271 expref: 13 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.984602:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:2.0:1787614231.984619:0:22642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.984628:0:22642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.984636:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614231.984662:0:22642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787614231.984710:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:2400:x1874448671210624:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 173us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614231.984717:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 16 00010000:00010000:3.0:1787614231.988964:0:24946:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.988981:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.989015:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.989029:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.989041:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990036:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990068:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990075:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787614231.990088:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787614231.990112:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990119:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990125:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990131:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614231.990135:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990141:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990153:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:3.0:1787614231.990185:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614231.990191:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990196:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0e17 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787614231.990209:0:24946:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b331eb44 reply state 000000004f27f83f transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990226:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990232:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8b5d43185800) 00010000:00010000:3.0:1787614231.990234:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787614231.990237:0:24946:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787614231.990376:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0e10 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 15 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990394:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 14 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614231.990401:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:3.0:1787614231.990403:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787614231.990405:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38000, rc 0) 00000100:00100000:3.0:1787614231.990533:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+15:18694:x1874448671210496:12345-192.168.206.55@tcp:101:bash.0 Request processed in 9164us (9470us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787614231.990541:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 37 00000040:00080000:2.0:1787614231.991493:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787614232.002732:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614232.003392:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671210752 00000100:00100000:2.0:1787614232.003403:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671210752 00000100:00100000:2.0:1787614232.003506:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:2.0:1787614232.003517:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+15:18694:x1874448671210752:12345-192.168.206.55@tcp:101:bash.0 00010000:00010000:2.0:1787614232.003541:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614232.003629:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718800/0x9719586bc2ef0e33 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244286 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003697:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003711:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003722:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787614232.003791:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787614232.003795:0:22655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787614232.003815:0:22655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003826:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003850:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718800/0x9719586bc2ef0e33 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003879:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.003888:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:2.0:1787614232.003891:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787614232.003895:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51719200, rc 0) 00000100:00100000:2.0:1787614232.003991:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+16:18694:x1874448671210752:12345-192.168.206.55@tcp:101:bash.0 Request processed in 476us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614232.003998:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 38 00000100:00100000:1.0:1787614232.007084:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.007202:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671211008 00000100:00100000:3.0:1787614232.007211:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671211008 00000100:00100000:3.0:1787614232.007260:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 5 00000100:00100000:3.0:1787614232.007269:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+16:18694:x1874448671211008:12345-192.168.206.55@tcp:35:bash.0 00000100:00100000:3.0:1787614232.007563:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+17:18694:x1874448671211008:12345-192.168.206.55@tcp:35:bash.0 Request processed in 285us (478us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1787614232.007572:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 5 10000000:01000000:0.0:1787614232.052152:0:22652:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787614232.052188:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5d423f9800 from 13 10000000:01000000:0.0:1787614232.052193:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787614232.052240:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.052251:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.052262:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.052302:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.052371:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.052419:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787614232.052582:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294016 00000100:00100000:3.0:1787614232.052590:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294016 00000100:00100000:3.0:1787614232.052642:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787614232.052652:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+20:22652:x1874448692294016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787614232.052665:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614232.052678:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5d43b39200/0x9719586bc2ef0e48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0e41 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.052701:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5d43b39200/0x9719586bc2ef0e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0e41 expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.052712:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5d43b39200/0x9719586bc2ef0e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0e41 expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.052721:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b39200, rc 0) 00000100:00100000:3.0:1787614232.052790:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e43b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692294016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.052797:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787614232.053001:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787614232.053016:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e48 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.053025:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0e48 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.053082:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.053109:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.053475:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787614232.062421:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294144 00000100:00100000:1.0:1787614232.062439:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294144 00000100:00100000:1.0:1787614232.062512:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787614232.062525:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692294144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787614232.062711:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692294144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (9600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.062719:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787614232.062966:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.063018:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.063073:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.063116:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614232.063188:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294272 00000100:00100000:2.0:1787614232.063193:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294272 00000100:00100000:2.0:1787614232.063227:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787614232.063234:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692294272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787614232.063328:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692294272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614232.063335:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787614232.063511:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787614232.066005:0:25698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787614232.074402:0:22652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787614232.074443:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787614232.074454:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e48 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.074466:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e82044600/0x9719586bc2ef0e41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e48 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614232.074478:0:22652:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787614232.074481:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5d4322b000 from 13 10000000:01000000:0.0:1787614232.074483:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787614232.074522:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.074530:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.074541:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.075675:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.077382:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.077445:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614232.077721:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294400 00000100:00100000:2.0:1787614232.077730:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294400 00000100:00100000:2.0:1787614232.077801:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787614232.077810:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+21:22652:x1874448692294400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614232.077825:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614232.077841:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51718800/0x9719586bc2ef0e56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0e4f expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.077867:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51718800/0x9719586bc2ef0e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0e4f expref: 22 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.077878:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51718800/0x9719586bc2ef0e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0e4f expref: 22 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.077888:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51718800, rc 0) 00000100:00100000:2.0:1787614232.077951:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692294400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614232.077958:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787614232.078098:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787614232.078114:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e56 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.078141:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0e56 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.078252:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.078296:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.078319:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787614232.078479:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294528 00000100:00100000:1.0:1787614232.078484:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294528 00000100:00100000:1.0:1787614232.078517:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787614232.078525:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692294528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787614232.078640:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692294528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.078647:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787614232.080489:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.080545:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.080627:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.080672:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787614232.080744:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294656 00000100:00100000:3.0:1787614232.080761:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294656 00000100:00100000:3.0:1787614232.080818:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787614232.080828:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692294656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787614232.080937:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692294656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.080944:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787614232.081988:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787614232.084301:0:25699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787614232.084692:0:22652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787614232.084713:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787614232.084723:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e56 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.084735:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e82045800/0x9719586bc2ef0e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e56 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614232.084746:0:22652:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787614232.084759:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5e51a93800 from 13 10000000:01000000:0.0:1787614232.084762:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787614232.084795:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.084803:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.084824:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.084847:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.084906:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.084949:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614232.085015:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294784 00000100:00100000:2.0:1787614232.085023:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294784 00000100:00100000:2.0:1787614232.085070:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787614232.085080:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+22:22652:x1874448692294784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787614232.085091:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787614232.085103:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5e51719400/0x9719586bc2ef0e64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0e5d expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.085124:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5e51719400/0x9719586bc2ef0e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0e5d expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.085134:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5e51719400/0x9719586bc2ef0e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0e5d expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.085150:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e51719400, rc 0) 00000100:00100000:2.0:1787614232.085225:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692294784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614232.085232:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787614232.086423:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787614232.086444:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e64 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.086455:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0e64 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.086525:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.086583:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.086623:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787614232.086955:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692294912 00000100:00100000:2.0:1787614232.086962:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692294912 00000100:00100000:2.0:1787614232.087006:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787614232.087015:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692294912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787614232.087144:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692294912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614232.087151:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787614232.087914:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692294912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.087955:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.088007:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.088043:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787614232.088092:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692295040 00000100:00100000:3.0:1787614232.088098:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692295040 00000100:00100000:3.0:1787614232.088147:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787614232.088181:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692295040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787614232.088291:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692295040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.088298:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787614232.088483:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787614232.089780:0:25700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787614232.093482:0:22652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787614232.093524:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787614232.093536:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e64 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.093945:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e82044c00/0x9719586bc2ef0e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e64 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787614232.093956:0:22652:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787614232.093959:0:22652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5e7af67800 from 13 10000000:01000000:0.0:1787614232.093962:0:22652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787614232.093998:0:22652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.094007:0:22652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.094018:0:22652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.094043:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.094107:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.094229:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787614232.097492:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692295168 00000100:00100000:3.0:1787614232.097507:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692295168 00000100:00100000:3.0:1787614232.097673:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787614232.097685:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+23:22652:x1874448692295168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787614232.097703:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614232.097720:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0e72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9719586bc2ef0e6b expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.097746:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9719586bc2ef0e6b expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.097772:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5d43b39c00/0x9719586bc2ef0e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9719586bc2ef0e6b expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.097781:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b39c00, rc 0) 00000100:00100000:3.0:1787614232.097862:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692295168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.097869:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787614232.097966:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787614232.097984:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e72 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.097995:0:22652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9719586bc2ef0e72 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.098066:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.098098:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.102797:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787614232.104241:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692295296 00000100:00100000:1.0:1787614232.104255:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692295296 00000100:00100000:1.0:1787614232.104325:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787614232.104335:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692295296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787614232.104494:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692295296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (6394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.104502:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787614232.105627:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.105682:0:22652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.105744:0:22652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614232.105789:0:22652:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787614232.106052:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692295424 00000100:00100000:1.0:1787614232.106059:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692295424 00000100:00100000:1.0:1787614232.106088:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787614232.106095:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692295424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787614232.106196:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed+24:22652:x1874448692295424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.106203:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787614232.108133:0:22652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7636bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:40bd2766-3e74-4d8d-ab12-1e4ea932a3ed:22652:1874448692295424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787614232.108784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.108857:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671211264 00000100:00100000:3.0:1787614232.108877:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671211264 00000100:00100000:3.0:1787614232.108931:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 39 00000100:00100000:3.0:1787614232.108942:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+17:18704:x1874448671211264:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:3.0:1787614232.108963:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614232.108991:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38e00/0x9719586bc2ef0e79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f97702924428d expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787614232.109079:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787614232.109212:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38e00/0x9719586bc2ef0e79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924428d expref: 19 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.109227:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5e5958e400) 00010000:00010000:3.0:1787614232.109230:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787614232.109235:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38e00/0x9719586bc2ef0e79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924428d expref: 19 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.109247:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38e00, rc 0) 00000100:00100000:3.0:1787614232.109720:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+18:18704:x1874448671211264:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 777us (936us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1787614232.109728:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 39 00000040:00080000:2.0:1787614232.111546:0:25701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787614232.112779:0:22652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787614232.112806:0:22652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787614232.112816:0:22652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e72 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.112829:0:22652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: ffff8b5e82044a00/0x9719586bc2ef0e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9719586bc2ef0e72 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614232.114862:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.114997:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671211520 00000100:00100000:0.0:1787614232.115006:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671211520 00000100:00100000:0.0:1787614232.115066:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:0.0:1787614232.115079:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+18:18704:x1874448671211520:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1787614232.115375:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+19:18704:x1874448671211520:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 300us (521us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1787614232.115383:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 6 00000100:00100000:1.0:1787614232.150534:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.150650:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671211776 00000100:00100000:0.0:1787614232.150661:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671211776 00000100:00100000:0.0:1787614232.150727:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1787614232.150739:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+19:18707:x1874448671211776:12345-192.168.206.55@tcp:101:lfs.0 00010000:00010000:0.0:1787614232.150788:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614232.150810:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0e87 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f977029244294 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.150942:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0e8e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.150956:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0e8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.150969:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0e8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787614232.150982:0:22657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787614232.151089:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0e87 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244294 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.151113:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0e8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244294 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.151122:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614232.151125:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787614232.151128:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82045000, rc 0) 00000100:00100000:0.0:1787614232.151528:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+21:18707:x1874448671211776:12345-192.168.206.55@tcp:101:lfs.0 Request processed in 788us (1000us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1787614232.151537:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 40 00000100:00100000:0.0:1787614232.160449:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614232.160548:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671211904 00000100:00100000:1.0:1787614232.160568:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671211904 00000100:00100000:1.0:1787614232.160626:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:1.0:1787614232.160636:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7636aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+21:18707:x1874448671211904:12345-192.168.206.55@tcp:54:lfs.0 00010000:00010000:1.0:1787614232.160708:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160733:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160744:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160790:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160797:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160804:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160810:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153e00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614232.160814:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160821:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160833:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614232.160836:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787614232.160841:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.160847:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0e9c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614232.160926:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7636aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+21:18707:x1874448671211904:12345-192.168.206.55@tcp:54:lfs.0 Request processed in 291us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.160939:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 41 00000100:00100000:3.0:1787614232.163524:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.163581:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.163719:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671212288 00000100:00100000:0.0:1787614232.163730:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671212288 00000100:00100000:0.0:1787614232.163805:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:0.0:1787614232.163816:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+21:18707:x1874448671212288:12345-192.168.206.55@tcp:35:lfs.0 00000100:00100000:0.0:1787614232.164034:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+22:18707:x1874448671212288:12345-192.168.206.55@tcp:35:lfs.0 Request processed in 219us (451us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787614232.164042:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 7 00000100:00100000:1.0:1787614232.164177:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671212032 00000100:00100000:1.0:1787614232.164182:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671212032 00000100:00100000:1.0:1787614232.164226:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:1.0:1787614232.164234:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+22:2403:x1874448671212032:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787614232.164245:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614232.164277:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0e8e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244294 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.164295:0:22641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614232.164300:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614232.164321:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+21:2403:x1874448671212032:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 88us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.164328:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000040:00080000:1.0:1787614232.242491:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787614232.394524:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.394877:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671212544 00000100:00100000:0.0:1787614232.394888:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671212544 00000100:00100000:0.0:1787614232.394953:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:0.0:1787614232.394964:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+21:18738:x1874448671212544:12345-192.168.206.55@tcp:101:cat.0 00010000:00010000:0.0:1787614232.394988:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614232.395008:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ea3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f97702924429b expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.395137:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0eaa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.395152:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0eaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.395201:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0eaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787614232.395212:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787614232.395348:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ea3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924429b expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.395368:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0eaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924429b expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.395401:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614232.395404:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787614232.395408:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82044400, rc 0) 00000100:00100000:0.0:1787614232.395468:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18738:x1874448671212544:12345-192.168.206.55@tcp:101:cat.0 Request processed in 505us (952us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787614232.395475:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 42 00000100:00100000:3.0:1787614232.399792:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.399836:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614232.399908:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671212928 00000100:00100000:1.0:1787614232.399920:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671212928 00000100:00100000:1.0:1787614232.399979:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:1.0:1787614232.399991:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+23:2400:x1874448671212928:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787614232.400007:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614232.400032:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0eaa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924429b expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.400052:0:22640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614232.400057:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614232.400146:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671212800 00000100:00100000:0.0:1787614232.400151:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671212800 00000100:00100000:0.0:1787614232.400206:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 8 00000100:00100000:0.0:1787614232.400214:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18738:x1874448671212800:12345-192.168.206.55@tcp:35:cat.0 00000100:00100000:1.0:1787614232.401110:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+24:2400:x1874448671212928:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 1116us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.401139:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:0.0:1787614232.401337:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18738:x1874448671212800:12345-192.168.206.55@tcp:35:cat.0 Request processed in 1122us (1555us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1787614232.401345:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 8 00010000:00010000:0.0:1787614232.433730:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614232.471933:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614232.472062:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671213184 00000100:00100000:1.0:1787614232.472073:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671213184 00000100:00100000:1.0:1787614232.472215:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:1.0:1787614232.472227:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18744:x1874448671213184:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:1.0:1787614232.472255:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614232.472275:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0eb8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442a2 expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472393:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472410:0:24946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 24 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472420:0:24946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472428:0:24946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472464:0:24946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472478:0:24946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 24 pid: 22655 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614232.472492:0:24946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43835180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24946:1874448692295552:192.168.206.55@tcp:104: 00010000:00010000:1.0:1787614232.472615:0:24946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 24 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.472625:0:24946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 24 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614232.472634:0:24946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43837b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24946:1874448692295680:192.168.206.55@tcp:104: 00000100:00100000:1.0:1787614232.472669:0:24946:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d42269a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787614232.478594:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614232.478641:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.478675:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671213312 00000100:00100000:0.0:1787614232.478686:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671213312 00010000:00010000:0.0:1787614232.478732:0:22642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 25 pid: 22655 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614232.478792:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671213440 00000100:00100000:0.0:1787614232.478796:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671213440 00010000:00010000:0.0:1787614232.478817:0:22642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 26 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614232.478895:0:24946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43835180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24946:1874448692295552:192.168.206.55@tcp:104: 00000100:00100000:1.0:1787614232.478907:0:24946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43837b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24946:1874448692295680:192.168.206.55@tcp:104: 00010000:00010000:1.0:1787614232.478929:0:24946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614232.479821:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1787614232.479839:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+26:2400:x1874448671213312:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614232.479856:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614232.479865:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 26 pid: 22655 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.479910:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 26 pid: 22655 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.479935:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0e3a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xf43f977029244286 expref: 26 pid: 22655 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.479953:0:22640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:3.0:1787614232.479958:0:22640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.479966:0:22640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.479973:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614232.480094:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+25:2400:x1874448671213312:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 261us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.480103:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 17 00000100:00100000:3.0:1787614232.480128:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 18 00000100:00100000:3.0:1787614232.480136:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7af2a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+24:2400:x1874448671213440:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614232.480144:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614232.480150:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 24 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480193:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 24 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480218:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0e25 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xf43f97702924427f expref: 24 pid: 24946 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480229:0:22640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:3.0:1787614232.480232:0:22640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480240:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480247:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480270:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614232.480291:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7af2a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+23:2400:x1874448671213440:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 157us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.480298:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 18 00010000:00010000:3.0:1787614232.480379:0:24946:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480386:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787614232.480404:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787614232.480562:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153e00/0x9719586bc2ef0eb8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a2 expref: 24 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480578:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153200/0x9719586bc2ef0ebf lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a2 expref: 23 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614232.480595:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:3.0:1787614232.480597:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787614232.480600:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153200, rc 0) 00000100:00100000:3.0:1787614232.480624:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18744:x1874448671213184:12345-192.168.206.55@tcp:101:dd.0 Request processed in 8401us (8703us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787614232.480631:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 43 00000100:00100000:2.0:1787614232.484028:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.484117:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671213568 00000100:00100000:0.0:1787614232.484128:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671213568 00000100:00100000:0.0:1787614232.484221:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:0.0:1787614232.484232:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18744:x1874448671213568:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:0.0:1787614232.484253:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614232.484273:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ecd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442a9 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.484308:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.484322:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.484332:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.484446:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ecd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 25 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.484465:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.484474:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614232.484477:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787614232.484480:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82045000, rc 0) 00000100:00100000:0.0:1787614232.486195:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+24:18744:x1874448671213568:12345-192.168.206.55@tcp:101:dd.0 Request processed in 1956us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614232.486206:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 44 00000100:00100000:1.0:1787614232.495942:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.496124:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671213824 00000100:00100000:3.0:1787614232.496135:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671213824 00000100:00100000:1.0:1787614232.496334:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 45 00000100:00100000:1.0:1787614232.496348:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+24:18744:x1874448671213824:12345-192.168.206.55@tcp:36:dd.0 00010000:00010000:1.0:1787614232.496652:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.496668:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.496678:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787614232.496720:0:24946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1787614232.496743:0:24946:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005334a6c0 reply state 000000003f027d32 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.496781:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.496789:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614232.496792:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787614232.496795:0:24946:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787614232.497005:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+27:18744:x1874448671213824:12345-192.168.206.55@tcp:36:dd.0 Request processed in 660us (1069us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1787614232.497013:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 45 00000020:00080000:1.0:1787614232.497018:0:24946:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787614232.501325:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614232.501427:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671213952 00000100:00100000:1.0:1787614232.501437:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671213952 00000100:00100000:1.0:1787614232.501552:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:1.0:1787614232.501564:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+27:18744:x1874448671213952:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:1.0:1787614232.501589:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614232.501611:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ee2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442b0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.501668:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ee2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b0 expref: 28 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.501682:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ee2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b0 expref: 28 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.501701:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614232.501705:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787614232.501709:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153000, rc 0) 00000100:00100000:1.0:1787614232.501794:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18744:x1874448671213952:12345-192.168.206.55@tcp:101:dd.0 Request processed in 232us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.501802:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 46 00000100:00100000:2.0:1787614232.517781:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614232.518016:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214208 00000100:00100000:1.0:1787614232.518026:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214208 00000100:00100000:1.0:1787614232.518133:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:1.0:1787614232.518145:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18744:x1874448671214208:12345-192.168.206.55@tcp:103:dd.0 00010000:00010000:1.0:1787614232.518178:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614232.518202:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ee2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b0 expref: 28 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614232.518222:0:22641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614232.518227:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614232.518288:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+27:18744:x1874448671214208:12345-192.168.206.55@tcp:103:dd.0 Request processed in 146us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.518297:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 2 00000100:00100000:3.0:1787614232.521316:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614232.522429:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214336 00000100:00100000:2.0:1787614232.522441:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214336 00000100:00100000:2.0:1787614232.522510:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:2.0:1787614232.522521:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+27:18744:x1874448671214336:12345-192.168.206.55@tcp:58:dd.0 00010000:00010000:2.0:1787614232.522625:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.522643:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614232.522670:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787614232.524500:0:22656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787614232.524538:0:22656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787614232.524684:0:22656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787614232.524802:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+27:18744:x1874448671214336:12345-192.168.206.55@tcp:58:dd.0 Request processed in 2276us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614232.524812:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 47 00000100:00100000:2.0:1787614232.526815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614232.526964:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214464 00000100:00100000:0.0:1787614232.526974:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214464 00000100:00100000:0.0:1787614232.527041:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:0.0:1787614232.527051:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e777f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+27:18744:x1874448671214464:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:0.0:1787614232.527072:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614232.527092:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442b7 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.527188:0:22655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.527199:0:22655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 28 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.527218:0:22655:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.527231:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 28 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.527245:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614232.527248:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787614232.527252:0:22655:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 28 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614232.527259:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82044e00, rc 0) 00000100:00100000:0.0:1787614232.527568:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e777f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18744:x1874448671214464:12345-192.168.206.55@tcp:101:dd.0 Request processed in 516us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614232.527576:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 48 00000100:00100000:3.0:1787614232.998391:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998438:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998465:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998490:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998543:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998568:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998611:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614232.998639:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214976 00000100:00100000:3.0:1787614232.998647:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214976 00000100:00100000:3.0:1787614232.998693:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671215488 00000100:00100000:3.0:1787614232.998695:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671215488 00000100:00100000:3.0:1787614232.998706:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214848 00000100:00100000:3.0:1787614232.998708:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214848 00000100:00100000:3.0:1787614232.998717:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671215360 00000100:00100000:3.0:1787614232.998718:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671215360 00000100:00100000:3.0:1787614232.998752:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:3.0:1787614232.998761:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671214976:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614232.998829:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671214976:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 69us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.998836:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:3.0:1787614232.998851:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:3.0:1787614232.998857:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2401:x1874448671215488:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614232.998874:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2401:x1874448671215488:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 18us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.998880:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:3.0:1787614232.998888:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1787614232.998893:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671214848:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614232.998908:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671214848:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 15us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.998913:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1787614232.998934:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:3.0:1787614232.998939:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2401:x1874448671215360:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:3.0:1787614232.998963:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2401:x1874448671215360:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614232.998968:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 23 00000100:00100000:1.0:1787614232.999084:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214592 00000100:00100000:1.0:1787614232.999089:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214592 00000100:00100000:1.0:1787614232.999127:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 166 00000100:00100000:1.0:1787614232.999135:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e440e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:2401:x1874448671214592:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614232.999215:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e440e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a1a9792-e19f-47a1-ac10-c3c97cb0a11a+13:2401:x1874448671214592:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 81us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.999223:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 166 00000100:00100000:1.0:1787614232.999271:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671214720 00000100:00100000:1.0:1787614232.999275:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671214720 00000100:00100000:1.0:1787614232.999314:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671215104 00000100:00100000:0.0:1787614232.999314:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671215232 00000100:00100000:1.0:1787614232.999318:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671215104 00000100:00100000:0.0:1787614232.999327:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671215232 00000100:00080000:2.0:1787614232.999340:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787614232.999346:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787614232.999349:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:1.0:1787614232.999357:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671214720:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1787614232.999367:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:0.0:1787614232.999378:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:2401:x1874448671215104:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:1.0:1787614232.999394:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671214720:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 37us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.999401:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:1.0:1787614232.999415:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:1.0:1787614232.999423:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d4328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2401:x1874448671215232:12345-192.168.206.55@tcp:400:kworker.0 00000100:00100000:0.0:1787614232.999434:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:519f82bc-988d-4bf1-a38f-1e4913fb5c38+12:2401:x1874448671215104:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 58us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614232.999443:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:1.0:1787614232.999453:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d4328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:519f82bc-988d-4bf1-a38f-1e4913fb5c38+5:2401:x1874448671215232:12345-192.168.206.55@tcp:400:kworker.0 Request processed in 30us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614232.999460:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00000040:00080000:2.0:1787614233.011989:0:22691:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787614233.011998:0:22691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787614233.012027:0:22691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787614233.012035:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787614233.012220:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7d184a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22691:1874448692295808:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787614233.012307:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e50bd76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614233.021503:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7d184a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22691:1874448692295808:192.168.206.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787614233.031282:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614233.033413:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671215616 00000100:00100000:0.0:1787614233.033428:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671215616 00000100:00100000:0.0:1787614233.033522:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00100000:0.0:1787614233.033535:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18745:x1874448671215616:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787614233.033578:0:24946:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787614233.033728:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18745:x1874448671215616:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 195us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614233.033898:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 49 00000100:00080000:2.0:1787614233.034232:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787614233.040329:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.040433:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671215744 00000100:00100000:1.0:1787614233.040443:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671215744 00000100:00100000:1.0:1787614233.040504:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:1.0:1787614233.040515:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18745:x1874448671215744:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787614233.040592:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040608:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040622:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040637:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040645:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040670:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040694:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040703:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040716:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614233.040782:0:22657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787614233.040786:0:22657:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614233.040798:0:22657:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040809:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040816:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040823:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040829:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.040834:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040841:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040860:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5d4312d600) 00010000:00010000:1.0:1787614233.040874:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614233.040879:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040885:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153000/0x9719586bc2ef0ef7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040900:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040906:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040911:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040916:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152e00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.040919:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040923:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040930:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8b5e5958e900) 00010000:00010000:1.0:1787614233.040932:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614233.040935:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040940:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0efe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040966:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040972:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040978:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040982:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153c00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.040985:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040990:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.040997:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614233.040999:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614233.041001:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.041006:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f05 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.041070:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18745:x1874448671215744:12345-192.168.206.55@tcp:34:lhsmtool_posix.0 Request processed in 557us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614233.041078:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 50 00000100:00100000:1.0:1787614233.045411:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614233.045484:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671216000 00000100:00100000:0.0:1787614233.045492:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671216000 00000100:00100000:0.0:1787614233.045554:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:0.0:1787614233.045564:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+28:18745:x1874448671216000:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787614233.045583:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614233.045600:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442be expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.045701:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.045716:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.045862:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787614233.045875:0:24946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787614233.046018:0:24946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046026:0:24946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046033:0:24946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046038:0:24946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82044200 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:0.0:1787614233.046042:0:24946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046049:0:24946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046062:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614233.046065:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787614233.046069:0:24946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046076:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f13 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046119:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f0c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442be expref: 30 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046142:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5d4312d600) 00010000:00010000:0.0:1787614233.046144:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787614233.046149:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442be expref: 30 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.046201:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82045a00, rc 0) 00000100:00100000:0.0:1787614233.046256:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+29:18745:x1874448671216000:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 692us (853us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1787614233.046264:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 51 00000100:00100000:0.0:1787614233.052006:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.052084:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671216128 00000100:00100000:1.0:1787614233.052094:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671216128 00000100:00100000:1.0:1787614233.052185:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:1.0:1787614233.052197:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+29:18745:x1874448671216128:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787614233.052237:0:22657:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787614233.052372:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+29:18745:x1874448671216128:12345-192.168.206.55@tcp:53:lhsmtool_posix.0 Request processed in 177us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614233.052381:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 52 00000100:00100000:2.0:1787614233.062920:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614233.063243:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671216384 00000100:00100000:0.0:1787614233.063253:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671216384 00000100:00100000:0.0:1787614233.063324:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:0.0:1787614233.063335:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+29:18745:x1874448671216384:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787614233.063355:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614233.063375:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f21 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442c5 expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787614233.063733:0:24946:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:0.0:1787614233.063757:0:24946:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:0.0:1787614233.063777:0:24946:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1787614233.064097:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f28 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.064112:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.064140:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.064249:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f21 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442c5 expref: 32 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.064266:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f28 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442c5 expref: 31 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.064275:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce800) 00010000:00010000:0.0:1787614233.064278:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787614233.064282:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82044200, rc 0) 00000100:00100000:0.0:1787614233.064340:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+31:18745:x1874448671216384:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1439us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1787614233.064348:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 53 00000100:00100000:1.0:1787614233.077335:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614233.077508:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671216640 00000100:00100000:2.0:1787614233.077519:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671216640 00000100:00100000:2.0:1787614233.077621:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:2.0:1787614233.077632:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+31:18745:x1874448671216640:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787614233.077688:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787614233.077725:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0f28 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442c5 expref: 31 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077765:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce800) 00010000:00010000:2.0:1787614233.077776:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787614233.077798:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077812:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077821:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077834:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077841:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077848:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077891:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077898:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077919:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077925:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719c00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614233.077936:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077944:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077953:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:2.0:1787614233.077956:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614233.077959:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077966:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719c00/0x9719586bc2ef0f36 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077975:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077981:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077987:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.077992:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719200 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614233.077995:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.078001:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.078008:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x2d8022b6 (ffff8b5d4312db00) 00010000:00010000:2.0:1787614233.078011:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787614233.078020:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.078025:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719200/0x9719586bc2ef0f3d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2d8022b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614233.078150:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+30:18745:x1874448671216640:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 519us (824us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787614233.078193:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 54 00000100:00100000:2.0:1787614233.080774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614233.081006:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671216768 00000100:00100000:0.0:1787614233.081015:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671216768 00000100:00100000:0.0:1787614233.081149:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:0.0:1787614233.081200:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+30:18745:x1874448671216768:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787614233.081219:0:24946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614233.081241:0:24946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f44 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442cc expref: -99 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.081540:0:24946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f4b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.081624:0:24946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.081635:0:24946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.081737:0:24946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045a00/0x9719586bc2ef0f44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442cc expref: 32 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.081833:0:24946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153c00/0x9719586bc2ef0f4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442cc expref: 31 pid: 24946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.081841:0:24946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:1.0:1787614233.081844:0:24946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787614233.081847:0:24946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153c00, rc 0) 00000100:00100000:1.0:1787614233.081907:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+31:18745:x1874448671216768:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 749us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614233.081979:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 55 00000100:00100000:0.0:1787614233.086146:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.086323:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671217024 00000100:00100000:3.0:1787614233.086332:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671217024 00000100:00100000:3.0:1787614233.086398:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:3.0:1787614233.086409:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+31:18745:x1874448671217024:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787614233.086507:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.086525:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.086537:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787614233.086719:0:22656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1787614233.086730:0:22656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730284571164ns, next at 731284568568ns, rc = 0 00000004:00010000:3.0:1787614233.087078:0:22656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005faec861 reply state 0000000056a784ec transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.087093:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.087101:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:3.0:1787614233.087104:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787614233.087108:0:22656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787614233.087377:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+33:18745:x1874448671217024:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 968us (1238us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787614233.087385:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 56 00000100:00100000:2.0:1787614233.110012:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.110203:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671217152 00000100:00100000:1.0:1787614233.110214:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671217152 00000100:00100000:1.0:1787614233.110280:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:1.0:1787614233.110291:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+33:18745:x1874448671217152:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787614233.110317:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614233.110337:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442d3 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.110396:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 34 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.110410:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 34 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.110429:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:1.0:1787614233.110431:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787614233.110434:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d152e00, rc 0) 00000100:00100000:1.0:1787614233.110498:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+34:18745:x1874448671217152:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 196us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614233.110505:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 57 00000100:00100000:2.0:1787614233.117868:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.118011:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671217280 00000100:00100000:3.0:1787614233.118021:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671217280 00000100:00100000:3.0:1787614233.118085:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:3.0:1787614233.118096:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e51720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2401:x1874448671217280:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787614233.118360:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e51720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2401:x1874448671217280:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 265us (500us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1787614233.118383:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1787614233.123356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.123472:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671217536 00000100:00100000:3.0:1787614233.123482:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671217536 00000100:00100000:3.0:1787614233.123657:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:3.0:1787614233.123668:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+34:18745:x1874448671217536:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787614233.123898:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+35:18745:x1874448671217536:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 232us (551us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1787614233.123906:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 9 00000100:00100000:1.0:1787614233.127416:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614233.127664:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671217792 00000100:00100000:2.0:1787614233.127674:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671217792 00000100:00100000:2.0:1787614233.127769:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:2.0:1787614233.127779:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+35:18745:x1874448671217792:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787614233.127892:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+35:18745:x1874448671217792:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614233.127901:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 58 00000100:00100000:0.0:1787614233.130629:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.130729:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671217920 00000100:00100000:1.0:1787614233.130738:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671217920 00000100:00100000:1.0:1787614233.130798:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:1.0:1787614233.130808:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+35:18745:x1874448671217920:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787614233.130825:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787614233.130844:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f60 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442da expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.131120:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f67 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.131134:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.131146:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787614233.131215:0:22655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787614233.131233:0:22655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.131258:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f60 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442da expref: 37 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.131336:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442da expref: 36 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.131345:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:1.0:1787614233.131348:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787614233.131352:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e7d153400, rc 0) 00000100:00100000:1.0:1787614233.131400:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+36:18745:x1874448671217920:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 593us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614233.131407:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 59 00000100:00100000:0.0:1787614233.135040:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.135122:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671218048 00000100:00100000:3.0:1787614233.135132:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671218048 00000100:00100000:3.0:1787614233.135205:0:25063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1787614233.135216:0:25063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2401:x1874448671218048:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787614233.135234:0:25063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614233.135254:0:25063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442e1 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787614233.135402:0:25063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cd418, blocks: 0x0 00010000:00010000:3.0:1787614233.135423:0:25063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1787614233.135428:0:25063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614233.135439:0:25063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 7 pid: 25063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.135460:0:25063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 7 pid: 25063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.135495:0:25063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38e00, rc 0) 00000100:00100000:3.0:1787614233.135654:0:25063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2401:x1874448671218048:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 439us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.135661:0:25063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:0.0:1787614233.138408:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.138490:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671218304 00000100:00100000:3.0:1787614233.138499:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671218304 00000100:00100000:3.0:1787614233.138565:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:3.0:1787614233.138577:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+36:18745:x1874448671218304:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787614233.138680:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+36:18745:x1874448671218304:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.138688:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 60 00000100:00100000:0.0:1787614233.141825:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.141921:0:24946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671218432 00000100:00100000:3.0:1787614233.141931:0:24946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671218432 00000100:00100000:3.0:1787614233.141992:0:24946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:3.0:1787614233.142003:0:24946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+36:18745:x1874448671218432:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787614233.145357:0:22635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1787614233.145371:0:22635:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787614233.145420:0:22635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1787614233.145471:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.145483:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.145490:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.145507:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152800 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:2.0:1787614233.145511:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.145519:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.145535:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:2.0:1787614233.145538:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787614233.145543:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614233.145755:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7d312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692295936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787614233.145822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614233.145876:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692295936 00000100:00100000:0.0:1787614233.145883:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692295936 00000100:00100000:0.0:1787614233.145945:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787614233.145955:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874448692295936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787614233.146088:0:24162:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787614233.146092:0:24162:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787614233.146095:0:24162:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787614233.146097:0:24162:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787614232 -> 1787614232 00002000:00010000:0.0:1787614233.146099:0:24162:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787614233.146138:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874448692295936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (315us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787614233.146146:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787614233.146189:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787614233.146215:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b5e7d312680/2, rc 0, transno 12884901892 00000100:00100000:0.0:1787614233.146221:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7d312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1874448692295936:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787614233.146485:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0dc3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146607:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146615:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146621:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146626:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719a00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614233.146638:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146646:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146657:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8b5d4312df00) 00010000:00010000:3.0:1787614233.146659:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614233.146663:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146669:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51719a00/0x9719586bc2ef0d6f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146685:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146691:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146697:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146701:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51718400 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614233.146703:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146709:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146716:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8b5d4312d200) 00010000:00010000:3.0:1787614233.146718:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614233.146727:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146750:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718400/0x9719586bc2ef0d76 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146764:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146770:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146776:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146781:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38600 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614233.146784:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146790:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146798:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8b5d43185800) 00010000:00010000:3.0:1787614233.146800:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614233.146803:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146809:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38600/0x9719586bc2ef0e1e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146823:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146839:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146845:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146850:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152a00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614233.146853:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146859:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146868:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:3.0:1787614233.146870:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787614233.146873:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146878:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152a00/0x9719586bc2ef0edb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146890:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146896:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146901:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.146906:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38000 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:3.0:1787614233.147152:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.147196:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.147205:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:3.0:1787614233.147208:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787614233.147211:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.147218:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f52 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614233.147332:0:24946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+15:18745:x1874448671218432:12345-192.168.206.55@tcp:44:lhsmtool_posix.0 Request processed in 5328us (5513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.147340:0:24946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 61 00000100:00100000:0.0:1787614233.150813:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.151028:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671218560 00000100:00100000:3.0:1787614233.151038:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671218560 00000100:00100000:3.0:1787614233.151095:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:3.0:1787614233.151106:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2400:x1874448671218560:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787614233.151247:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2400:x1874448671218560:12345-192.168.206.55@tcp:16:lhsmtool_posix.0 Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.151254:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 24 00000100:00100000:0.0:1787614233.156040:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.156233:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671218816 00000100:00100000:3.0:1787614233.156242:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671218816 00000100:00100000:3.0:1787614233.156307:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:3.0:1787614233.156317:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+15:18745:x1874448671218816:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787614233.156365:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614233.156401:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f67 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442da expref: 15 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.156421:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:3.0:1787614233.156425:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787614233.156451:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f75 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.156463:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.156471:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787614233.156593:0:22656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000059ed37f reply state 000000006d61c12e transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.156606:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38000/0x9719586bc2ef0f75 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.156612:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:3.0:1787614233.156614:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787614233.156617:0:22656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787614233.156722:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+16:18745:x1874448671218816:12345-192.168.206.55@tcp:36:lhsmtool_posix.0 Request processed in 406us (705us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787614233.156731:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 62 00000100:00100000:2.0:1787614233.160263:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.160460:0:25063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671218944 00000100:00100000:3.0:1787614233.160469:0:25063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671218944 00000100:00100000:3.0:1787614233.160513:0:25063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:3.0:1787614233.160521:0:25063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6351567f-8d3a-494f-ba5f-bbc65334b239+7:18745:x1874448671218944:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787614233.160564:0:25063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787614233.160583:0:25063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442e8 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.160613:0:25063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.160622:0:25063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614233.160625:0:25063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614233.160630:0:25063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 8 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.160661:0:25063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.160674:0:25063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614233.160686:0:25063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25063:1874448692296064:192.168.206.55@tcp:104: 00000100:00100000:3.0:1787614233.161095:0:25063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e763b0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787614233.164810:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.164946:0:25063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25063:1874448692296064:192.168.206.55@tcp:104: 00010000:00010000:3.0:1787614233.164979:0:25063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 8 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.165000:0:25063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5d43b38600, rc 0) 00000100:00100000:3.0:1787614233.165432:0:25063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6351567f-8d3a-494f-ba5f-bbc65334b239+8:18745:x1874448671218944:12345-192.168.206.55@tcp:101:lhsmtool_posix.0 Request processed in 4910us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.165442:0:25063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 25 00000100:00100000:1.0:1787614233.166627:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219072 00000100:00100000:1.0:1787614233.166641:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219072 00010000:00010000:1.0:1787614233.166686:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.166734:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:1.0:1787614233.166903:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d311500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+8:2400:x1874448671219072:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787614233.166926:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614233.166948:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.166962:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.166984:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4121aec/0x9719586bc2ef0f6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e1 expref: 8 pid: 25063 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.166999:0:22640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614233.167004:0:22640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787614233.167010:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 7 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.167031:0:22640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 7 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.167069:0:22640:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 7 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.167096:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22640:1874448692296192:192.168.206.55@tcp:105: 00000100:00100000:1.0:1787614233.167225:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d422693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614233.174135:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.174302:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22640:1874448692296192:192.168.206.55@tcp:105: 00010000:00010000:1.0:1787614233.174326:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614233.174376:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d311500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2400:x1874448671219072:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 7478us (9575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614233.174447:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219200 00000100:00100000:2.0:1787614233.174455:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219200 00000100:00100000:2.0:1787614233.174507:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:2.0:1787614233.174517:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+8:2402:x1874448671219200:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787614233.174663:0:24165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787614233.174667:0:24165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787614232 00002000:00010000:2.0:1787614233.174670:0:24165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787614231 00002000:00010000:2.0:1787614233.174672:0:24165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787614232 -> 1787614232 00002000:00010000:2.0:1787614233.174675:0:24165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787614233.174700:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+9:2402:x1874448671219200:12345-192.168.206.55@tcp:2:lhsmtool_posix.0 Request processed in 185us (574us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787614233.174708:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 26 00000100:00100000:1.0:1787614233.176982:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 19 00000100:00100000:2.0:1787614233.179318:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614233.179639:0:24657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219328 00000100:00100000:0.0:1787614233.179648:0:24657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219328 00000100:00100000:0.0:1787614233.179711:0:24657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:0.0:1787614233.179721:0:24657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+8:2403:x1874448671219328:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787614233.179906:0:24657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.180005:0:24657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 8 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.180014:0:24657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787614233.180092:0:24657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787614233.180099:0:24657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.180138:0:24657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 8 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.180152:0:24657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 8 pid: 25063 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614233.180210:0:24657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7d310700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24657:1874448692296320:192.168.206.55@tcp:104: 00000100:00100000:0.0:1787614233.180347:0:24657:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e5078d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787614233.185371:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.185517:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219456 00000100:00100000:1.0:1787614233.185528:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219456 00010000:00010000:1.0:1787614233.185581:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 9 pid: 25063 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.185627:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 20 00000100:00100000:1.0:1787614233.185637:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+9:2401:x1874448671219456:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787614233.185652:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787614233.185676:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 9 pid: 25063 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.185690:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 9 pid: 25063 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.185714:0:22641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787614233.185719:0:22641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787614233.185756:0:22641:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.185766:0:22641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.185787:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787614233.185839:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+9:2401:x1874448671219456:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 203us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787614233.185846:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 20 00010000:00010000:0.0:1787614233.187642:0:24657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acfd346c/0x9719586bc2ef0f7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442e8 expref: 8 pid: 25063 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614233.187663:0:24657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7d310700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24657:1874448692296320:192.168.206.55@tcp:104: 00010000:00010000:0.0:1787614233.187687:0:24657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.187717:0:24657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.187725:0:24657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.187835:0:24657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.187845:0:24657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.187853:0:24657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.187860:0:24657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e82045a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:0.0:1787614233.188015:0:24657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.188026:0:24657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.188045:0:24657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.188062:0:24657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cae04f4e/0x9719586bc2ef0f83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614233.188248:0:24657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6351567f-8d3a-494f-ba5f-bbc65334b239+7:2403:x1874448671219328:12345-192.168.206.55@tcp:1:lhsmtool_posix.0 Request processed in 8528us (8938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614233.188258:0:24657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 27 00000100:00100000:0.0:1787614233.194764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.194887:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219712 00000100:00100000:1.0:1787614233.194896:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219712 00000100:00100000:1.0:1787614233.194956:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 63 00000100:00100000:1.0:1787614233.194966:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+16:18745:x1874448671219712:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787614233.195051:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.195067:0:22657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.195077:0:22657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.195108:0:22657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.195120:0:22657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 16 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.195153:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22657:1874448692296448:192.168.206.55@tcp:104: 00000100:00100000:1.0:1787614233.200857:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d422693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787614233.207941:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:0.0:1787614233.208941:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219840 00000100:00100000:0.0:1787614233.208952:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219840 00010000:00010000:0.0:1787614233.208992:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 17 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787614233.209026:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 21 00000100:00100000:0.0:1787614233.209036:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+17:2400:x1874448671219840:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787614233.209051:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787614233.209057:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 17 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.209070:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 17 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.209091:0:22640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614233.209097:0:22640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.209125:0:22640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.209134:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.209141:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.209192:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787614233.209245:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6351567f-8d3a-494f-ba5f-bbc65334b239+17:2400:x1874448671219840:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 210us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614233.209252:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 21 00010000:00010000:1.0:1787614233.211034:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82045000/0x9719586bc2ef0ed4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442a9 expref: 16 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.211056:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22657:1874448692296448:192.168.206.55@tcp:104: 00010000:00010000:1.0:1787614233.211079:0:22657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211088:0:22657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211093:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211372:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211385:0:22657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211393:0:22657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211440:0:22657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.211455:0:22657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 16 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.211476:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22657:1874448692296576:192.168.206.55@tcp:104: 00000100:00100000:1.0:1787614233.211567:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5d42269d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787614233.214852:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.215042:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671219968 00000100:00100000:3.0:1787614233.215052:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671219968 00010000:00010000:3.0:1787614233.215089:0:22642:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 17 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787614233.215126:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 22 00000100:00100000:3.0:1787614233.215136:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+17:2401:x1874448671219968:12345-192.168.206.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787614233.215149:0:22642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787614233.215155:0:22642:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 17 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.215189:0:22642:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 17 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.215210:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:3.0:1787614233.215215:0:22642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.215225:0:22642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.215232:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.215250:0:22642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787614233.215334:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+17:2401:x1874448671219968:12345-192.168.206.55@tcp:103:ldlm_bl.0 Request processed in 198us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.215341:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 22 00010000:00010000:1.0:1787614233.216721:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152e00/0x9719586bc2ef0f59 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.55@tcp remote: 0xf43f9770292442d3 expref: 16 pid: 22655 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.216753:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22657:1874448692296576:192.168.206.55@tcp:104: 00010000:00010000:1.0:1787614233.216775:0:22657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.216785:0:22657:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.216791:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787614233.217016:0:22657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1787614233.217137:0:22657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1787614233.217198:0:22657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1787614233.217349:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22657:1874448692296704:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787614233.217480:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614233.217648:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e70a280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787614233.217695:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692296704 00000100:00100000:3.0:1787614233.217702:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692296704 00000100:00100000:3.0:1787614233.217762:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787614233.217773:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22657:x1874448692296704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787614233.218088:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22657:x1874448692296704:12345-0@lo:1000:mdt00_002.0 Request processed in 316us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.218095:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787614233.218353:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22657:1874448692296704:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787614233.218661:0:22657:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787614233.218716:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22657:1874448692296832:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787614233.218781:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787614233.218858:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787614233.219049:0:23398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692296832 00000100:00100000:2.0:1787614233.219056:0:23398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692296832 00000100:00100000:2.0:1787614233.219133:0:23398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787614233.219142:0:23398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22657:x1874448692296832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787614233.219295:0:23398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22657:x1874448692296832:12345-0@lo:1000:mdt00_002.0 Request processed in 154us (513us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1787614233.219302:0:23398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787614233.219382:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22657:1874448692296832:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787614233.219430:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219440:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219447:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219453:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153400 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.219458:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219465:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219480:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:1.0:1787614233.219483:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787614233.219487:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219493:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153400/0x9719586bc2ef0f91 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219521:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219528:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219534:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219559:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51718c00 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.219562:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219568:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219577:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614233.219580:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787614233.219587:0:22657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 19 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219598:0:22657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 19 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219606:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 19 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.219654:0:22657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044e00/0x9719586bc2ef0ef0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442b7 expref: 19 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.219665:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43834a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22657:1874448692296960:192.168.206.55@tcp:105: 00000100:00100000:1.0:1787614233.219731:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5e4851c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787614233.223925:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.224129:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671220096 00000100:00100000:3.0:1787614233.224138:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671220096 00000100:00100000:3.0:1787614233.224200:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:3.0:1787614233.224211:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e4388fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+20:18744:x1874448671220096:12345-192.168.206.55@tcp:49:dd.0 00000100:00100000:3.0:1787614233.224352:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e4388fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+20:18744:x1874448671220096:12345-192.168.206.55@tcp:49:dd.0 Request processed in 143us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614233.224360:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 10 00000100:00100000:0.0:1787614233.227534:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:1.0:1787614233.227988:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43834a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22657:1874448692296960:192.168.206.55@tcp:105: 00010000:00010000:1.0:1787614233.228015:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228043:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e51718c00/0x9719586bc2ef0ee9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228076:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228089:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228101:0:22657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228112:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228119:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228125:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228131:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d152800 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.228135:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228142:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228153:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614233.228187:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787614233.228192:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228207:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d152800/0x9719586bc2ef0f98 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228219:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228225:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228231:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228236:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e7d153800 already unused, calling callback (ffffffffc1aab4f0) 00010000:00010000:1.0:1787614233.228239:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228245:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228254:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:1.0:1787614233.228256:0:22657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787614233.228259:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.228278:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e7d153800/0x9719586bc2ef0f8a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22657 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787614233.228716:0:22691:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787614233.228721:0:22691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787614233.228760:0:22691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787614233.228766:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787614233.229009:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6351567f-8d3a-494f-ba5f-bbc65334b239+19:18745:x1874448671219712:12345-192.168.206.55@tcp:57:lhsmtool_posix.0 Request processed in 34041us (34250us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787614233.229020:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 63 00000020:00080000:1.0:1787614233.229033:0:22657:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787614233.229057:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671220224 00000100:00100000:1.0:1787614233.229063:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671220224 00000100:00100000:2.0:1787614233.230876:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:2.0:1787614233.231876:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.232144:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671220480 00000100:00100000:3.0:1787614233.232154:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671220480 00000100:00100000:3.0:1787614233.232223:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 11 00000100:00100000:3.0:1787614233.232233:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+20:18745:x1874448671220480:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787614233.232495:0:22659:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787614233.232522:0:22659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1787614233.232579:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.232595:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.232607:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.232614:0:22659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.232620:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.232627:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.232644:0:22659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787614233.233420:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+22:18744:x1874448671220224:12345-192.168.206.55@tcp:101:dd.0 00010000:00010000:0.0:1787614233.233435:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787614233.233450:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0fa6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf43f9770292442ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.233479:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0fad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.233488:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0fad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.233496:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0fad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.233603:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044400/0x9719586bc2ef0fa6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442ef expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.233620:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5e82044200/0x9719586bc2ef0fad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.55@tcp remote: 0xf43f9770292442ef expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787614233.233628:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8b5d43185e00) 00010000:00010000:0.0:1787614233.233631:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787614233.233634:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5e82044200, rc 0) 00000100:00100000:3.0:1787614233.234044:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+23:18745:x1874448671220480:12345-192.168.206.55@tcp:35:lhsmtool_posix.0 Request processed in 1810us (2180us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787614233.234054:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 11 00000020:00080000:3.0:1787614233.234059:0:22659:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787614233.234083:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787614233.234088:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.234095:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:3.0:1787614233.234099:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.234107:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.234128:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8b5e601ce000) 00010000:00010000:3.0:1787614233.234130:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787614233.234133:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.234139:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5d43b38a00/0x9719586bc2ef0f9f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.234148:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614233.234150:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614233.234151:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787614233.234661:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+22:18744:x1874448671220224:12345-192.168.206.55@tcp:101:dd.0 Request processed in 3769us (7133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614233.234670:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 64 00000100:00100000:2.0:1787614233.264650:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:2.0:1787614233.264694:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.55@tcp (source: 12345-192.168.206.55@tcp) 00000100:00100000:3.0:1787614233.264796:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671220736 00000100:00100000:3.0:1787614233.264807:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671220736 00000100:00100000:3.0:1787614233.264870:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448671220608 00000100:00100000:3.0:1787614233.264873:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448671220608 00000100:00100000:3.0:1787614233.264894:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:3.0:1787614233.264904:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+8:2400:x1874448671220736:12345-192.168.206.55@tcp:4:dd.0 00002000:00010000:3.0:1787614233.264958:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8cd418, atime: 0x6a8cd417, ctime: 0x6a8cd418, blocks: 0x0 00010000:00010000:3.0:1787614233.264968:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.264985:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1787614233.264990:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787614233.264996:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787614233.265009:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787614233.344505:0:24159:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1787614233.344520:0:24159:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1787614233.345257:0:24169:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1787614233.345264:0:24169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1787614233.345282:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345295:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345303:0:24169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345311:0:24169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5d43b38a00 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:2.0:1787614233.345316:0:24169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345337:0:24169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345358:0:24169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345366:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16b55ba/0x9719586bc2ef0fb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787614233.345480:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+6:2400:x1874448671220736:12345-192.168.206.55@tcp:4:dd.0 Request processed in 80570us (80832us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787614233.345494:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 0 00000100:00100000:2.0:1787614233.345527:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.55@tcp, seq: 1 00000100:00100000:2.0:1787614233.345541:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671220608:12345-192.168.206.55@tcp:4:dd.0 00002000:00010000:2.0:1787614233.345580:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a8cd418, atime: 0x6a8cd417, ctime: 0x6a8cd418, blocks: 0x1a68 00010000:00010000:2.0:1787614233.345587:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345598:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1787614233.345603:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787614233.345610:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787614233.345622:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787614233.416621:0:24159:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:1.0:1787614233.418202:0:24169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1787614233.418226:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.418238:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.418247:0:24169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.418255:0:24169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5e51719200 already unused, calling callback (ffffffffc0eb3230) 00010000:00010000:1.0:1787614233.418272:0:24169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.418282:0:24169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.418300:0:24169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787614233.418307:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc5d1be/0x9719586bc2ef0fbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787614233.418426:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6351567f-8d3a-494f-ba5f-bbc65334b239+5:2400:x1874448671220608:12345-192.168.206.55@tcp:4:dd.0 Request processed in 72884us (153726us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787614233.418440:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.55@tcp, seq: 1 00010000:00010000:0.0:1787614233.457564:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787614234.481287:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787614234.929512:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787614234.929536:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7d184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692297088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787614234.929607:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787614234.929701:0:24166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692297088 00000100:00100000:2.0:1787614234.929710:0:24166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692297088 00000100:00100000:2.0:1787614234.929781:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787614234.929791:0:24166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692297088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787614234.929820:0:24166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787614234.929867:0:24166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874448692297088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787614234.929874:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787614234.929923:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7d184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1874448692297088:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787614234.929967:0:22651:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787614234.933077:0:25739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787614235.505774:0:22644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787614236.465852:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787614236.465864:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5e7d312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692297344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614236.465886:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5d43a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692297216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787614236.468950:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787614236.469052:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692297216 00000100:00100000:3.0:1787614236.469064:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692297216 00000100:00100000:0.0:1787614236.469564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787614236.469637:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874448692297344 00000100:00100000:0.0:1787614236.469643:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874448692297344 00000100:00100000:0.0:1787614236.469708:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787614236.469720:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5e7d311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692297344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787614236.469780:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787614236.469843:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5e7d311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874448692297344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787614236.469852:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787614236.469922:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5e7d312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1874448692297344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787614236.474078:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787614236.474096:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5d43a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692297216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787614236.474147:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1787614236.474293:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5d43a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874448692297216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 201us (5354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787614236.474301:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787614236.474369:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5d43a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1874448692297216:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787614236.531633:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14149 lines, 14149 kept, 0 dropped, 0 bad.