00010000:00010000:1.0F:1783947684.597104:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1783947684.840958:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947684.841029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947684.841128:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089216 00000100:00100000:1.0:1783947684.841139:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089216 00002000:00100000:1.0:1783947684.841211:0:18598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9e7ac76b5c00 x1870604214089216/t0(0) o4->bc51fa7f-2744-43d7-9883-dba4b4b8d1ba@192.168.204.3@tcp:475/0 lens 504/0 e 0 to 0 dl 1783947695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1783947684.841223:0:18598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac76b5c00 with x1870604214089216 ext(0->8) 00002000:00010000:1.0:1783947684.841228:0:18598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e7ac76b5c00 00000100:00100000:1.0:1783947684.841253:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1783947684.841263:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+8:2406:x1870604214089216:12345-192.168.204.3@tcp:4:bash.0 00000100:00100000:3.0F:1783947684.842098:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089344 00000100:00100000:3.0:1783947684.842112:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089344 00000100:00100000:3.0:1783947684.842160:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:3.0:1783947684.842168:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+11:2406:x1870604214089344:12345-192.168.204.3@tcp:16:kworker.0 00000100:00080000:2.0:1783947684.842752:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947684.843779:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+11:2406:x1870604214089216:12345-192.168.204.3@tcp:4:bash.0 Request processed in 2510us (2823us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783947684.843799:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00002000:00100000:2.0:1783947684.843814:0:18598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9e7ac76b5c00 x1870604214089216/t8589934599(0) o4->bc51fa7f-2744-43d7-9883-dba4b4b8d1ba@192.168.204.3@tcp:475/0 lens 504/448 e 0 to 0 dl 1783947695 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1783947684.843824:0:18598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac76b5c00 with x1870604214089216 ext(0->8) 00002000:00010000:2.0:1783947684.843831:0:18598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e7ac76b5c00 00000001:00080000:1.0:1783947684.844010:0:19409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1783947684.844020:0:19409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:2.0:1783947684.844176:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2406:x1870604214089344:12345-192.168.204.3@tcp:16:kworker.0 Request processed in 2008us (3145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947684.844197:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000040:00080000:1.0:1783947684.980890:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783947685.622965:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947686.131726:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236181248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947686.131801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947686.131984:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181248 00000100:00100000:3.0:1783947686.131993:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181248 00000100:00100000:3.0:1783947686.132046:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947686.132055:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236181248:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0F:1783947686.132055:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1783947686.132080:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691962368 00000100:00100000:3.0:1783947686.132139:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236181248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947686.132146:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947686.132155:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236181376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947686.132196:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947686.132222:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181376 00000100:00100000:2.0:1783947686.132226:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181376 00000100:00100000:2.0:1783947686.132254:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947686.132260:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236181376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783947686.132269:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691962368 00000100:00100000:2.0:1783947686.132293:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236181376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.132300:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1783947686.132313:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947686.132350:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236181888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947686.132402:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236182400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132424:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947686.132435:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236181504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132477:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236181376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947686.132481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947686.132501:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236182016:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132508:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181888 00000100:00100000:2.0:1783947686.132511:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181888 00000100:00100000:3.0:1783947686.132524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947686.132534:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182400 00000100:00100000:3.0:1783947686.132537:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236182528:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132537:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182400 00000100:00100000:3.0:1783947686.132556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947686.132557:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947686.132563:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236181888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947686.132590:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181504 00000100:00100000:3.0:1783947686.132593:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181504 00000100:00100000:3.0:1783947686.132618:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783947686.132623:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236181888:12345-0@lo:400:kworker.0 Request processed in 60us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947686.132624:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3638:x1870604236181504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132629:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947686.132640:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182528 00000100:00100000:2.0:1783947686.132643:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182528 00000100:00100000:3.0:1783947686.132655:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3638:x1870604236181504:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.132658:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947686.132661:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783947686.132663:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236182400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947686.132687:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236181632:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132688:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236182400:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.132693:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947686.132704:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947686.132709:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236182528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947686.132717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947686.132731:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236182144:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132731:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236182528:12345-0@lo:400:kworker.0 Request processed in 22us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.132736:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783947686.132752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947686.132759:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947686.132762:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947686.132768:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236182656:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132771:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182144 00000100:00100000:2.0:1783947686.132778:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182144 00000100:00100000:3.0:1783947686.132786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947686.132799:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783947686.132805:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236181760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132807:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947686.132812:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236182144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947686.132823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947686.132835:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236182272:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132836:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236182144:12345-0@lo:400:kworker.0 Request processed in 24us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.132842:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947686.132851:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181760 00000100:00100000:3.0:1783947686.132852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947686.132853:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181760 00000100:00100000:3.0:1783947686.132865:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236182784:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132870:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947686.132875:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236181760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947686.132896:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947686.132898:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236181760:12345-0@lo:400:kworker.0 Request processed in 23us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.132903:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947686.132917:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236182144:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132923:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182656 00000100:00100000:2.0:1783947686.132926:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182656 00000100:00100000:3.0:1783947686.132932:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236181760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132944:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182272 00000100:00100000:2.0:1783947686.132947:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182272 00000100:00100000:3.0:1783947686.132950:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236181504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132957:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182784 00000100:00100000:2.0:1783947686.132959:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182784 00010000:00080000:3.0:1783947686.132961:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7f9b100 x1870604236182528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947686.132971:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236182528:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.132971:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947686.132976:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236182656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.133006:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236182656:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.133011:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947686.133022:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947686.133026:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236182272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.133048:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236182272:12345-0@lo:400:kworker.0 Request processed in 22us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.133061:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947686.133072:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947686.133077:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236182784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.133102:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236182784:12345-0@lo:400:kworker.0 Request processed in 25us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947686.133107:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947686.133129:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236182272:0@lo:400:kworker.0 00010000:00080000:2.0:1783947686.133138:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7f98000 x1870604236182784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947686.133147:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236182784:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.133154:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236182656:0@lo:400:kworker.0 00000100:00080000:2.0:1783947686.133189:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947686.133192:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947686.133194:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947686.133209:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236181888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.133218:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236182400:0@lo:400:kworker.0 00000100:00100000:0.0:1783947686.133804:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1783947686.133811:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7be3e9fb80, transno 8589934596 00000004:00080000:0.0:1783947686.133821:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1783947686.133843:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236181248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947686.134085:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182016 00000100:00100000:1.0:1783947686.134091:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182016 00000100:00100000:1.0:1783947686.134135:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181632 00000100:00100000:1.0:1783947686.134139:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181632 00000100:00100000:1.0:1783947686.134154:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947686.134172:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236182016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947686.134232:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236182016:12345-0@lo:400:kworker.0 Request processed in 71us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947686.134238:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947686.134253:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947686.134259:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236181632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947686.134287:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236181632:12345-0@lo:400:kworker.0 Request processed in 29us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947686.134302:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947686.134338:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236182016:0@lo:400:kworker.0 00000100:00100000:2.0:1783947686.135704:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236181632:0@lo:400:kworker.0 00000001:00080000:0.0:1783947686.140819:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1783947686.140847:0:17067:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7ac7683a80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1783947686.140852:0:17067:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7be7800800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac7683300 00000020:00080000:0.0:1783947686.140855:0:17067:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7be7800200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bf7a3c800 00000020:00080000:0.0:1783947686.140878:0:17127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1783947686.140940:0:17127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783947686.141127:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947686.141139:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947686.141146:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947686.141152:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947686.141170:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947686.141180:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947686.141200:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:1.0:1783947686.141203:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947686.141208:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947686.141215:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947686.650803:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947687.327190:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.327294:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089472 00000100:00100000:3.0:1783947687.327305:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089472 00000100:00100000:3.0:1783947687.327390:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:3.0:1783947687.327402:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:15586:x1870604214089472:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783947687.327545:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:15586:x1870604214089472:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 146us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947687.327561:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00080000:2.0:1783947687.327693:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947687.334125:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947687.337064:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089600 00000100:00100000:2.0:1783947687.337081:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089600 00000100:00100000:2.0:1783947687.337188:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:2.0:1783947687.337201:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15586:x1870604214089600:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783947687.337333:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15586:x1870604214089600:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 135us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947687.337340:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00080000:0.0:1783947687.341263:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947687.360919:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.368308:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089856 00000100:00100000:3.0:1783947687.368326:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089856 00000100:00100000:2.0:1783947687.368663:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1783947687.368676:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7f31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:15586:x1870604214089856:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783947687.368952:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7f31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+13:15586:x1870604214089856:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 278us (8044us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1783947687.368961:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00010000:00010000:2.0:1783947687.667728:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947687.915798:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.915888:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089984 00000100:00100000:3.0:1783947687.915898:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089984 00000100:00100000:3.0:1783947687.915959:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 169 00000100:00100000:3.0:1783947687.915969:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214089984:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947687.916043:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214089984:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947687.916051:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 169 00000100:00100000:3.0:1783947687.918555:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.918595:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.918642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.918678:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947687.918691:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090112 00000100:00100000:0.0:1783947687.918701:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090112 00000100:00100000:3.0:1783947687.918707:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947687.918731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947687.918762:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090240 00000100:00100000:0.0:1783947687.918767:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090240 00000100:00100000:3.0:1783947687.918772:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090368 00000100:00100000:3.0:1783947687.918779:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090368 00000100:00100000:0.0:1783947687.918787:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090624 00000100:00100000:0.0:1783947687.918792:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090624 00000100:00100000:3.0:1783947687.918815:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090496 00000100:00100000:3.0:1783947687.918820:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090496 00000100:00100000:0.0:1783947687.918827:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090752 00000100:00100000:0.0:1783947687.918832:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090752 00000100:00100000:0.0:1783947687.918855:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:3.0:1783947687.918867:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:0.0:1783947687.918869:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2409:x1870604214090240:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947687.918880:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2409:x1870604214090368:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947687.918945:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2409:x1870604214090368:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947687.918954:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:1.0:1783947687.918975:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:1.0:1783947687.918989:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214090496:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947687.919012:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1783947687.919065:0:18594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1783947687.919074:0:18594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1783947687.919088:0:19073:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1783947687.919097:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:2.0:1783947687.919104:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2405:x1870604214090624:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:2.0:1783947687.919136:0:19073:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555017b9 00000100:00080000:2.0:1783947687.919150:0:19073:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947687.919195:0:19073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783947687.919340:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2405:x1870604214090112:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:3.0:1783947687.919357:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550177a 00000100:00080000:3.0:1783947687.919363:0:18595:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947687.919389:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1783947687.921351:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2409:x1870604214090240:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2475us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947687.921370:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00080000:0.0:1783947687.921417:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947687.921438:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947687.921441:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947687.921444:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783947687.921482:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947687.921703:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947687.922302:0:20439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1783947687.922316:0:20439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2405:x1870604214090752:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:0.0:1783947687.922347:0:20439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555017c0 00000100:00080000:0.0:1783947687.922364:0:20439:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc0800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783947687.922407:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783947687.922445:0:20439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1783947687.922643:0:20439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+2:2405:x1870604214090752:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 331us (3909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947687.922652:0:20439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:1.0:1783947687.928918:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214090496:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 9919us (10225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947687.928948:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:2.0:1783947687.935300:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+2:2405:x1870604214090624:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 16183us (16582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947687.935317:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1783947687.937794:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+2:2405:x1870604214090112:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 18760us (19240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947687.937810:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00010000:00010000:0.0:1783947688.691945:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947689.205509:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236182912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947689.205615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947689.205986:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236182912 00000100:00100000:1.0:1783947689.205996:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236182912 00000100:00100000:0.0:1783947689.206038:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947689.206046:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236183040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947689.206059:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783947689.206069:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236182912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947689.206088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1783947689.206119:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947689.206130:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183040 00000100:00100000:0.0:1783947689.206133:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183040 00000100:00100000:0.0:1783947689.206164:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947689.206171:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236183040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947689.206201:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783947689.206247:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236183040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947689.206254:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1783947689.206259:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947689.206304:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236183040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947689.206319:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236182912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947689.206353:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236182912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947689.206360:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947689.206711:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236183168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947689.206748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947689.206826:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183168 00000100:00100000:2.0:1783947689.206830:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183168 00000100:00100000:2.0:1783947689.206867:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783947689.206874:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236183168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947689.206896:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947689.206931:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236183168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947689.206938:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947689.207201:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236183296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947689.207248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947689.207328:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236183168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947689.207806:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183296 00000100:00100000:2.0:1783947689.207812:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183296 00000100:00100000:2.0:1783947689.207862:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947689.207870:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236183296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783947689.207887:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1783947689.207990:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947689.219595:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236183296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11712us (12332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947689.219611:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947689.219814:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236183296:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783947689.716031:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947690.739921:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947691.253735:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236183552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947691.253810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947691.253877:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947691.253883:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236183424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947691.253907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947691.253941:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183552 00000100:00100000:3.0:1783947691.254137:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183552 00000100:00100000:3.0:1783947691.254281:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183424 00000100:00100000:3.0:1783947691.254285:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183424 00000100:00080000:1.0:1783947691.254422:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947691.255144:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947691.255154:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236183552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947691.255191:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1783947691.255262:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236183552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947691.255381:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236183552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947691.255420:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947691.255471:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947691.255478:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236183424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947691.255639:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1783947691.255680:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236183424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947691.255685:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947691.256048:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236184064:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256058:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236183680:0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.256102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947691.256109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947691.256129:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236184576:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256135:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236184192:0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.256149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947691.256155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947691.256168:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236184704:0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.256180:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236183424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947691.256186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947691.256197:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783947691.256202:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783947691.256203:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236183936:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256206:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236183808:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947691.256225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947691.256239:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236184320:0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.256247:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236184448:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947691.256264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947691.256273:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236184832:0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.256294:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236184960:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947691.256313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947691.256331:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184064 00000100:00100000:2.0:1783947691.256335:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184064 00000100:00100000:2.0:1783947691.256362:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184576 00000100:00100000:2.0:1783947691.256364:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184576 00000100:00100000:0.0:1783947691.256404:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183680 00000100:00100000:0.0:1783947691.256408:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183680 00000100:00100000:0.0:1783947691.256435:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783947691.256442:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236183680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256499:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236183680:12345-0@lo:400:kworker.0 Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947691.256507:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783947691.256539:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184192 00000100:00100000:0.0:1783947691.256547:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184192 00000100:00100000:0.0:1783947691.256570:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183808 00000100:00100000:0.0:1783947691.256573:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183808 00000100:00100000:0.0:1783947691.256585:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947691.256590:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236184192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256623:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236184192:12345-0@lo:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947691.256629:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947691.256640:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783947691.256646:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236183808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.256702:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236183808:12345-0@lo:400:kworker.0 Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947691.256707:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783947691.256723:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184704 00000100:00100000:0.0:1783947691.256727:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184704 00000100:00080000:1.0:1783947691.258214:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947691.258222:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947691.258248:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184448 00000100:00100000:1.0:1783947691.258256:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184448 00000100:00100000:1.0:1783947691.258301:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184832 00000100:00100000:1.0:1783947691.258304:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184832 00000100:00100000:1.0:1783947691.258327:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184960 00000100:00100000:1.0:1783947691.258330:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184960 00000100:00100000:1.0:1783947691.258350:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947691.258358:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236184064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.258444:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236184064:12345-0@lo:400:kworker.0 Request processed in 86us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947691.258451:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947691.258484:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783947691.259036:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236184448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.259096:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236184448:12345-0@lo:400:kworker.0 Request processed in 606us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947691.259110:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783947691.259127:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947691.259134:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236184832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.259165:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236184832:12345-0@lo:400:kworker.0 Request processed in 33us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947691.259170:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947691.259182:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947691.259189:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236184960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.259216:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236184960:12345-0@lo:400:kworker.0 Request processed in 28us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947691.259221:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947691.259645:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236184448:0@lo:400:kworker.0 00010000:00080000:1.0:1783947691.259673:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7af1f80 x1870604236184960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947691.259685:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236184960:0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.259698:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236184064:0@lo:400:kworker.0 00000100:00080000:1.0:1783947691.259729:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947691.259733:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947691.260771:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947691.260782:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236184576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.260850:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236184576:12345-0@lo:400:kworker.0 Request processed in 70us (4699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947691.260856:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947691.261083:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236184576:0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.261650:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236183936 00000100:00100000:1.0:1783947691.261657:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236183936 00000100:00100000:1.0:1783947691.261715:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236184320 00000100:00100000:1.0:1783947691.261718:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236184320 00000100:00100000:1.0:1783947691.261738:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947691.261751:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236183936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.261807:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236183936:12345-0@lo:400:kworker.0 Request processed in 56us (5580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947691.261814:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947691.261828:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947691.261833:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236184320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947691.261861:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236184320:12345-0@lo:400:kworker.0 Request processed in 28us (5601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947691.261867:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947691.261911:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236183936:0@lo:400:kworker.0 00000100:00080000:2.0:1783947691.262377:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947691.262781:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236183808:0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.263643:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783947691.263658:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236184704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947691.263719:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236184704:12345-0@lo:400:kworker.0 Request processed in 67us (7531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947691.263727:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783947691.264169:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236184320:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.264181:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236184832:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.264193:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236183680:0@lo:400:kworker.0 00000100:00100000:0.0:1783947691.264204:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236184192:0@lo:400:kworker.0 00010000:00080000:0.0:1783947691.264218:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7af1180 x1870604236184704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947691.264229:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236184704:0@lo:400:kworker.0 00000040:00080000:1.0:1783947691.443742:0:17123:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783947691.443751:0:17123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947691.443772:0:17123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783947691.443780:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:2.0:1783947691.552431:0:20477:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:01:29 (1783947689) 00000001:00080000:0.0:1783947691.770738:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:0.0:1783947691.770758:0:17067:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1783947691.770779:0:17127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1783947691.770789:0:17127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1783947691.790094:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947692.853830:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947693.039634:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947693.039670:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947693.039733:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947693.039782:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214090880 00000100:00100000:1.0:1783947693.039793:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214090880 00000100:00100000:1.0:1783947693.039849:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:1.0:1783947693.039859:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214090880:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947693.039932:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214090880:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 75us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947693.039940:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:0.0:1783947693.043726:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947693.043842:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091136 00000100:00100000:2.0:1783947693.043852:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091136 00000100:00100000:2.0:1783947693.043914:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091392 00000100:00100000:2.0:1783947693.043918:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091392 00000100:00100000:2.0:1783947693.043944:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:2.0:1783947693.043955:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214091136:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947693.044052:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214091136:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 99us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.044060:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:2.0:1783947693.044079:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:2.0:1783947693.044086:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2408:x1870604214091392:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947693.044111:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2408:x1870604214091392:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947693.044117:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00080000:2.0:1783947693.044135:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947693.044140:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947693.045222:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947693.045255:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947693.045280:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091264 00000100:00100000:0.0:1783947693.045285:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091264 00000100:00100000:0.0:1783947693.045331:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:0.0:1783947693.045340:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2408:x1870604214091264:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947693.045383:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2408:x1870604214091264:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.045390:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:0.0:1783947693.045409:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091008 00000100:00100000:0.0:1783947693.045411:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091008 00000100:00100000:0.0:1783947693.045431:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091520 00000100:00100000:0.0:1783947693.045433:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091520 00000100:00100000:0.0:1783947693.045449:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:0.0:1783947693.045476:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:2408:x1870604214091008:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947693.045507:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:2408:x1870604214091008:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 52us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.045513:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:0.0:1783947693.045526:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:0.0:1783947693.045540:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2408:x1870604214091520:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947693.045566:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2408:x1870604214091520:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947693.045572:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00080000:0.0:1783947693.045587:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947693.045590:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947693.045593:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1783947693.816647:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000020:00000080:1.0:1783947693.816658:0:19409:0:(genops.c:906:class_export_put()) final put ffff9e7ac5bc0000/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00100000:2.0:1783947693.816662:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000020:00000080:2.0:1783947693.816667:0:18589:0:(genops.c:906:class_export_put()) final put ffff9e7bf34cf000/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00100000:2.0:1783947693.816891:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000020:00000080:2.0:1783947693.816894:0:18589:0:(genops.c:906:class_export_put()) final put ffff9e7ac5bc5800/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000020:00000080:3.0:1783947693.818932:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bf34cf000/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba for lustre-OST0000 00000020:00000080:3.0:1783947693.819024:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bf34ca800 for lustre-OST0000 00000020:00000080:3.0:1783947693.819487:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5bc0000/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e for lustre-OST0001 00000020:00000080:3.0:1783947693.819528:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5bc0800 for lustre-OST0001 00000020:00000080:3.0:1783947693.819819:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5bc5800/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e for lustre-OST0000 00000020:00000080:3.0:1783947693.819841:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5bc7000 for lustre-OST0000 00010000:00010000:2.0:1783947693.876364:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947694.196274:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947694.323883:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236185088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947694.323962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947694.324054:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185088 00000100:00100000:3.0:1783947694.324061:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185088 00000100:00100000:3.0:1783947694.324116:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783947694.324126:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236185088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947694.324158:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947694.324204:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236185088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947694.324212:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947694.324401:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236185216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947694.324434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947694.324525:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947694.324529:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236185472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947694.324536:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236185344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947694.324576:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947694.324578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947694.324633:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185472 00000100:00100000:1.0:1783947694.324639:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185472 00000100:00100000:3.0:1783947694.324646:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236185088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947694.324674:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783947694.324683:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236185472:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783947694.324689:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783947694.324697:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947694.324736:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236185472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947694.324744:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947694.324761:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236185472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947694.330079:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185216 00000100:00100000:1.0:1783947694.330173:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185216 00000100:00100000:1.0:1783947694.330279:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185344 00000100:00100000:1.0:1783947694.330283:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185344 00000100:00100000:0.0:1783947694.330323:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947694.330337:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236185216:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947694.330368:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947694.330384:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236185344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947694.330385:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000004:00000024:2.0:1783947694.330409:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947694.330577:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236185216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 242us (6140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947694.330585:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947694.333200:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236185344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947694.333227:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236185216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947694.333317:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236185344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2936us (8740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947694.333329:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:0.0:1783947694.899922:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947695.406282:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947695.406320:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947695.406417:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947695.406499:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091648 00000100:00100000:1.0:1783947695.406511:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091648 00000100:00100000:2.0:1783947695.406531:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947695.406575:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214092032 00000100:00100000:1.0:1783947695.406593:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214092032 00000100:00100000:2.0:1783947695.406610:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214092160 00000100:00100000:2.0:1783947695.406617:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214092160 00000100:00100000:2.0:1783947695.406674:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1783947695.406698:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2405:x1870604214092160:12345-192.168.204.3@tcp:9:umount.0 00000020:00000080:2.0:1783947695.406750:0:18593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501781 00000020:00010000:2.0:1783947695.406762:0:18593:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7bf34c9000: total 0 00000100:00080000:2.0:1783947695.406769:0:18593:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ce800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783947695.406842:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214091776 00000100:00100000:1.0:1783947695.406846:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214091776 00000100:00100000:1.0:1783947695.406861:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1783947695.406868:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+15:2408:x1870604214091648:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947695.406880:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947695.406898:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb55501757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4260 expref: 15 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.406915:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947695.406967:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+14:2408:x1870604214091648:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 99us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.406975:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1783947695.407148:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000001:00000004:2.0:1783947695.407169:0:18593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1783947695.407176:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214092032:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947695.407186:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947695.407197:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55400/0xe6fd1fdb5550181b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4347 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.407206:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947695.407228:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:2408:x1870604214092032:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 56us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.407234:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1783947695.407250:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1783947695.407256:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:2408:x1870604214091776:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947695.407265:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947695.407275:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb5550175e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4291 expref: 11 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.407286:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947695.407307:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:2408:x1870604214091776:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 51us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947695.407313:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:2.0:1783947695.407336:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+4:2405:x1870604214092160:12345-192.168.204.3@tcp:9:umount.0 Request processed in 644us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947695.407346:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000020:00010000:1.0:1783947695.407351:0:17075:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7bf34c9000: total 0 00010000:00010000:1.0:1783947695.407356:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947695.407392:0:17075:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7bf34c9000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1783947695.407428:0:17075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783947695.407431:0:17075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1783947679 -> 1783947680 00002000:00010000:1.0:1783947695.407434:0:17075:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783947679 -> 1783947680 00002000:00010000:1.0:1783947695.407437:0:17075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783947695.407453:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501aec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4427 expref: 3 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947695.407518:0:17075:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7bf34c9000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783947695.407532:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947695.407534:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947695.407536:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947695.408104:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947695.408713:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947695.420309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947695.420943:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093056 00000100:00100000:0.0:1783947695.420954:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093056 00000100:00100000:0.0:1783947695.421047:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:0.0:1783947695.421059:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:2405:x1870604214093056:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:0.0:1783947695.421105:0:17089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501773 00000020:00010000:0.0:1783947695.421121:0:17089:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7ac5bc2800: total 0 00000100:00080000:0.0:1783947695.421126:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947695.421158:0:17089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1783947695.421341:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+11:2405:x1870604214093056:12345-192.168.204.3@tcp:39:umount.0 Request processed in 273us (1030us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1783947695.421350:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00000020:00010000:0.0:1783947695.421386:0:17076:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7ac5bc2800: total 0 00000100:00080000:3.0:1783947695.421564:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783947695.421797:0:17076:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7ac5bc2800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1783947695.421839:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:0.0:1783947695.421843:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947695.421855:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4404 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.421879:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7be782f900) 00010000:00010000:0.0:1783947695.421882:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947695.421886:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55501853 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4355 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.421900:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:0.0:1783947695.421902:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947695.421906:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55501892 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4363 expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.421919:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947695.421921:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947695.421925:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.421952:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947695.421954:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947695.421958:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501b01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e442e expref: 6 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.421985:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7ac761ec00) 00010000:00010000:0.0:1783947695.421989:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947695.421993:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ea00/0xe6fd1fdb55501837 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e434e expref: 5 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.422007:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947695.422010:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783947695.422013:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438200/0xe6fd1fdb55501917 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e438d expref: 4 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947695.422024:0:17076:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7ac5bc2800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1783947695.422038:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947695.422041:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947695.422042:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947695.422481:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947695.435957:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947695.439269:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093184 00000100:00100000:1.0:1783947695.439283:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093184 00000100:00100000:1.0:1783947695.440146:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:1.0:1783947695.440159:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2405:x1870604214093184:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:1.0:1783947695.440193:0:18616:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550176c 00000100:00080000:1.0:1783947695.440230:0:18616:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5823800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947695.440259:0:18616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1783947695.440545:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+3:2405:x1870604214093184:12345-192.168.204.3@tcp:39:umount.0 Request processed in 389us (4597us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783947695.440553:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00010000:00010000:0.0:1783947695.440833:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947695.440924:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783947695.924804:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947696.371700:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947696.371725:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236185600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947696.371792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947696.371850:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185600 00000100:00100000:1.0:1783947696.371859:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185600 00000100:00080000:2.0:1783947696.371899:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947696.371920:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947696.371932:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236185600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947696.371972:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1783947696.372031:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236185600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947696.372039:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947696.372110:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236185728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947696.372162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947696.372188:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236186240:0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.372222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947696.372244:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236186752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.372264:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186240 00000100:00100000:1.0:1783947696.372268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.372271:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186240 00000100:00100000:1.0:1783947696.372294:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236187264:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.372309:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186752 00000100:00100000:0.0:1783947696.372314:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186752 00000100:00100000:1.0:1783947696.372320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.372335:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187264 00000100:00100000:0.0:1783947696.372339:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187264 00000100:00100000:1.0:1783947696.372344:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783947696.372352:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236185856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.372368:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783947696.372381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.372387:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236186240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.372407:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236186368:0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.372443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.372444:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236186240:12345-0@lo:400:kworker.0 Request processed in 59us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.372477:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783947696.372487:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236186880:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.372498:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783947696.372507:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236186752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.372514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.372551:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236186752:12345-0@lo:400:kworker.0 Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947696.372557:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236186240:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.372559:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783947696.372575:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186880 00000100:00100000:1.0:1783947696.372578:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236186752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.372580:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186880 00000100:00100000:0.0:1783947696.372605:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783947696.372613:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186368 00000100:00100000:0.0:1783947696.372613:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236187264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.372619:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186368 00000100:00100000:1.0:1783947696.372649:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783947696.372656:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236186368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947696.372837:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236186112:0@lo:400:kworker.0 00000100:00100000:2.0:1783947696.373673:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783947696.373697:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236186880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.378827:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236187264:12345-0@lo:400:kworker.0 Request processed in 6204us (6497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.378843:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783947696.378898:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185856 00000100:00100000:0.0:1783947696.378907:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185856 00000100:00100000:0.0:1783947696.378977:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783947696.378986:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236185856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.379057:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236185856:12345-0@lo:400:kworker.0 Request processed in 73us (6676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.379063:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1783947696.379094:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947696.379099:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947696.379153:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185728 00000100:00100000:0.0:1783947696.379157:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185728 00000100:00100000:0.0:1783947696.379207:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947696.379213:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236185728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947696.379230:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1783947696.379265:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236185728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (7103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.379272:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1783947696.379287:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947696.379318:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236185856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.379362:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236185984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.379398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.379424:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236186496:0@lo:400:kworker.0 00000100:00100000:3.0:1783947696.380357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947696.380389:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236186624:0@lo:400:kworker.0 00000100:00100000:3.0:1783947696.380412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947696.380431:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236187136:0@lo:400:kworker.0 00000100:00100000:2.0:1783947696.380496:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236186880:12345-0@lo:400:kworker.0 Request processed in 6811us (7981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.380507:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783947696.380516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947696.380544:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236187008:0@lo:400:kworker.0 00000100:00100000:2.0:1783947696.380562:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236185984 00000100:00100000:2.0:1783947696.380569:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236185984 00000100:00100000:0.0:1783947696.380573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947696.380608:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947696.380618:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236185984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.380620:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236185600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947696.380661:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187008 00000100:00100000:0.0:1783947696.380665:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187008 00000100:00100000:0.0:1783947696.380701:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783947696.380708:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236187008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.380746:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236187008:12345-0@lo:400:kworker.0 Request processed in 39us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.380752:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1783947696.380766:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947696.380891:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236185984:12345-0@lo:400:kworker.0 Request processed in 274us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.380898:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947696.382498:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186112 00000100:00100000:2.0:1783947696.382510:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186112 00000100:00100000:0.0:1783947696.383096:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236185984:0@lo:400:kworker.0 00010000:00080000:0.0:1783947696.383117:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7a15f80 x1870604236187008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947696.383139:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236187008:0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.383194:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186624 00000100:00100000:0.0:1783947696.383199:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186624 00000100:00100000:0.0:1783947696.383240:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236186496 00000100:00100000:0.0:1783947696.383244:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236186496 00000100:00100000:2.0:1783947696.383509:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947696.383521:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236186624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947696.383771:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236186624:12345-0@lo:400:kworker.0 Request processed in 253us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.383780:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947696.383797:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947696.383804:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947696.383836:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236186112:12345-0@lo:400:kworker.0 Request processed in 33us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947696.383842:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783947696.384778:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783947696.384788:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236186496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947696.384853:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236186496:12345-0@lo:400:kworker.0 Request processed in 67us (4337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.384861:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1783947696.384887:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947696.384918:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236186368:12345-0@lo:400:kworker.0 Request processed in 12258us (12472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947696.384929:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236186496:0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.384931:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947696.385048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947696.385092:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236186112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947696.385104:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236186624:0@lo:400:kworker.0 00000100:00100000:3.0:1783947696.385127:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187136 00000100:00100000:3.0:1783947696.385132:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187136 00000100:00100000:3.0:1783947696.385168:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783947696.385175:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236187136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947696.385213:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236187136:12345-0@lo:400:kworker.0 Request processed in 38us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947696.385219:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1783947696.385236:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947696.385254:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236187136:0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.385372:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236186368:0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.385402:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236186880:0@lo:400:kworker.0 00010000:00080000:1.0:1783947696.385417:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7a16300 x1870604236187264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947696.385427:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236187264:0@lo:400:kworker.0 00000100:00100000:1.0:1783947696.385447:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236185728:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947696.947729:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947697.600557:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947697.600604:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947697.600642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947697.600787:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093312 00000100:00100000:1.0:1783947697.600791:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093568 00000100:00100000:1.0:1783947697.600800:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093568 00000100:00100000:2.0:1783947697.600806:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093312 00000100:00100000:2.0:1783947697.600862:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093440 00000100:00100000:2.0:1783947697.600865:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093440 00000100:00100000:3.0:1783947697.600917:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:3.0:1783947697.600928:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:2409:x1870604214093312:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947697.600967:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947697.600989:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb55501796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e42d0 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947697.601010:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947697.601066:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:2409:x1870604214093312:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 139us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947697.601075:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1783947697.605694:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:1.0:1783947697.605721:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:2409:x1870604214093568:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947697.605739:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947697.605760:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846a200/0xe6fd1fdb55501814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4340 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947697.605778:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947697.605850:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:2409:x1870604214093568:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 143us (5244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947697.605858:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:2.0:1783947697.607126:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1783947697.607146:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+9:2409:x1870604214093440:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947697.607162:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947697.607178:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5ee00/0xe6fd1fdb5550179d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4301 expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.607194:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947697.607254:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:2409:x1870604214093440:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 117us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947697.607263:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:0.0:1783947697.615991:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947697.616091:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093824 00000100:00100000:2.0:1783947697.616112:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093824 00000100:00100000:2.0:1783947697.616189:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1783947697.616200:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2405:x1870604214093824:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:2.0:1783947697.616242:0:17089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555017ab 00000020:00010000:2.0:1783947697.616249:0:17089:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7bf34c8000: total 0 00000100:00080000:2.0:1783947697.616254:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34cb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947697.616284:0:17089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:3.0:1783947697.616482:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947697.616726:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2405:x1870604214093824:12345-192.168.204.3@tcp:39:umount.0 Request processed in 527us (744us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1783947697.616735:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00000020:00010000:0.0:1783947697.617208:0:17076:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7bf34c8000: total 0 00010000:00010000:0.0:1783947697.617212:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947697.617260:0:17076:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7bf34c8000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783947697.617296:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:0.0:1783947697.617300:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947697.617309:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb555018a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e436a expref: 4 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947697.617332:0:17076:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7bf34c8000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783947697.617343:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947697.617344:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947697.617346:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947697.617646:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947697.635654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947697.635792:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214093952 00000100:00100000:3.0:1783947697.635802:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214093952 00000100:00100000:3.0:1783947697.635881:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:3.0:1783947697.635892:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2405:x1870604214093952:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:3.0:1783947697.635935:0:17087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555017b2 00000100:00080000:3.0:1783947697.635954:0:17087:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947697.635990:0:17087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1783947697.636144:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+3:2405:x1870604214093952:12345-192.168.204.3@tcp:39:umount.0 Request processed in 254us (498us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783947697.636152:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00010000:00010000:1.0:1783947697.636303:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947697.636662:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947697.687543:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947697.687692:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094208 00000100:00100000:1.0:1783947697.687702:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094208 00000100:00100000:1.0:1783947697.687762:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00100000:1.0:1783947697.687787:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+7:2405:x1870604214094208:12345-192.168.204.3@tcp:251:umount.0 00000020:00000080:1.0:1783947697.687837:0:17080:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501749 00000020:00010000:1.0:1783947697.687845:0:17080:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7bf7a89000: total 0 00000100:00080000:1.0:1783947697.687863:0:17080:0:(import.c:65:import_set_state_nolock()) ffff9e7bf7a8a800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783947697.688171:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947697.688288:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+3:2405:x1870604214094208:12345-192.168.204.3@tcp:251:umount.0 Request processed in 515us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947697.688298:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 173 00000020:00010000:2.0:1783947697.688608:0:17076:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7bf7a89000: total 0 00010000:00010000:2.0:1783947697.688681:0:17076:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7bf7a89000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783947697.688718:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f000/0xe6fd1fdb55501750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4259 expref: 3 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947697.688735:0:17076:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7bf7a89000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1783947697.688746:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947697.688748:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947697.688750:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947697.688911:0:17080:0:(genops.c:906:class_export_put()) final put ffff9e7bf7a89000/a84253a8-4830-4b12-9d0f-3006cd9f4d80 00000020:00000080:0.0:1783947697.689109:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bf7a89000/a84253a8-4830-4b12-9d0f-3006cd9f4d80 for MGS 00000020:00000080:0.0:1783947697.689160:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bf7a8a800 for MGS 00010000:00010000:2.0:1783947697.971710:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947698.995962:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947699.447148:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236187392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947699.447221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947699.447359:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187392 00000100:00100000:0.0:1783947699.447367:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187392 00000100:00100000:0.0:1783947699.447424:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947699.447433:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236187392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947699.447498:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947699.447544:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236187392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947699.447549:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236187520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947699.447551:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783947699.447577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947699.447609:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947699.447615:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236187648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947699.447636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947699.447650:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236187776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947699.447673:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187520 00000100:00100000:3.0:1783947699.447676:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187520 00000100:00100000:2.0:1783947699.447689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947699.447704:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187648 00000100:00100000:3.0:1783947699.447707:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187648 00000100:00100000:3.0:1783947699.447722:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783947699.447724:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187776 00000100:00100000:2.0:1783947699.447727:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187776 00000100:00100000:3.0:1783947699.447728:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236187520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947699.447746:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783947699.447748:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947699.447754:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236187776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947699.447777:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1783947699.447778:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236187520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947699.447784:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947699.447795:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947699.447801:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236187648:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947699.447807:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236187776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947699.447812:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00002000:00000024:3.0:1783947699.447825:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947699.447849:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236187648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947699.447852:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236187776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947699.447855:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1783947699.447868:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947699.447896:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236187392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947699.453666:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236187648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947699.453691:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236187520:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1783947699.464269:0:20672:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783947699.482581:0:20672:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783947699.482633:0:20672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.482648:0:20672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.482656:0:20672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.482679:0:20672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.482701:0:20672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783947699.482707:0:20672:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783947699.482731:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947699.482735:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783947699.482737:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1783947699.482740:0:20672:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1783947699.482744:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.482751:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947699.482754:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783947699.482762:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783947699.482762:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947699.482769:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947699.482774:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947699.482776:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783947699.482779:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783947699.482804:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.482812:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947699.482843:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.482861:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.482871:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.482873:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.482875:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947699.482884:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947699.482915:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236188032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947699.482983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947699.483039:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188032 00000100:00100000:2.0:1783947699.483045:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188032 00000100:00100000:2.0:1783947699.483093:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947699.483102:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236188032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947699.483113:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947699.483127:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d54600/0xe6fd1fdb55501313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550130c expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.483139:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947699.483173:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:3639:x1870604236188032:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947699.483180:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947699.483245:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236188032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947699.483305:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236187904:0@lo:39:umount.0 00000100:00100000:0.0:1783947699.483336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.483491:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236187904 00000100:00100000:1.0:1783947699.483496:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236187904 00000100:00100000:1.0:1783947699.483531:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947699.483537:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870604236187904:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783947699.483560:0:18616:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550133d 00000100:00080000:1.0:1783947699.483567:0:18616:0:(import.c:65:import_set_state_nolock()) ffff9e7bff958800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783947699.483619:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1870604236187904:12345-0@lo:39:umount.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.483625:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1783947699.483633:0:18616:0:(genops.c:906:class_export_put()) final put ffff9e7bff958000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783947699.483655:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947699.483673:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783947699.483680:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236187904:0@lo:39:umount.0 00000020:00000080:1.0:1783947699.483698:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bff958000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783947699.483739:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bff958800 for lustre-MDT0000 00000100:00080000:3.0:1783947699.485571:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947699.485579:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783947699.485585:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783947699.486758:0:20672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486772:0:20672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486780:0:20672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486787:0:20672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486802:0:20672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947699.486809:0:20672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486840:0:20672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486846:0:20672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486852:0:20672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486865:0:20672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947699.486872:0:20672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486878:0:20672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486883:0:20672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486890:0:20672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486897:0:20672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783947699.486913:0:20672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486920:0:20672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486936:0:20672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486942:0:20672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947699.486951:0:20672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783947699.486955:0:20672:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783947699.486979:0:20672:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783947699.486983:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783947699.486988:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947699.486994:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1783947699.487001:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7bf34c8800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947699.487006:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7be7a20800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947699.487010:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7ac674d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947699.487015:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7bc9512800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947699.487021:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e7bf34c8000 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 192.168.204.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1783947699.487026:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e7ac5bc2800 bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 192.168.204.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1783947699.487031:0:20672:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e7ac66f0000) has exports, disconnecting them 00000020:00080000:3.0:1783947699.487035:0:20672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7bf34c8800), last request at 1783947696 00000020:00000080:3.0:1783947699.487042:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501638 00000100:00080000:3.0:1783947699.487060:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34cb800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783947699.487103:0:20672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bf34c8800): rc 0 00000020:00000080:3.0:1783947699.487107:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bf34c8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783947699.487117:0:20672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7be7a20800), last request at 1783947696 00000020:00000080:3.0:1783947699.487126:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555014da 00000100:00080000:3.0:1783947699.487131:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a27800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783947699.487139:0:20672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7a20800): rc 0 00000020:00000080:3.0:1783947699.487142:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7be7a20800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783947699.487146:0:20672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7ac674d000), last request at 1783947622 00000020:00000080:3.0:1783947699.487148:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550142b 00000100:00080000:3.0:1783947699.487151:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7ac674e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783947699.487155:0:20672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac674d000): rc 0 00000020:00000080:3.0:1783947699.487156:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac674d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783947699.487160:0:20672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7bc9512800), last request at 1783947622 00000020:00000080:3.0:1783947699.487163:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013c9 00000100:00080000:3.0:1783947699.487166:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7ac769a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947699.487171:0:20672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1783947699.487243:0:20672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bc9512800): rc 0 00000004:00000080:3.0:1783947699.487250:0:20672:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7948793fae0 00000100:00080000:3.0:1783947699.487269:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783947699.487273:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1783947699.487684:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783947699.487694:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.487703:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947699.487707:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.487728:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947699.487736:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947699.487742:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947699.487744:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1783947699.487747:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783947699.487781:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.487786:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1783947699.488269:0:20672:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783947699.488331:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783947699.490586:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490605:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490626:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783947699.490630:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490637:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ae00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947699.490641:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490651:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947699.490677:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947699.490683:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947699.490686:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783947699.490690:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783947699.490731:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490738:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947699.490752:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490758:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490767:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947699.490771:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490776:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947699.490779:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490784:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947699.490790:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947699.490804:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783947699.490807:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783947699.490809:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783947699.490822:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490827:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947699.490838:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947699.490844:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490850:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.490860:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947699.490861:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947699.490863:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947699.490876:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bf34c8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783947699.490934:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a20800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783947699.490958:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac674d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783947699.490979:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bf34cb800 for lustre-MDT0000 00000020:00000080:1.0:1783947699.490983:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7a27800 for lustre-MDT0000 00000020:00000080:1.0:1783947699.490986:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac674e000 for lustre-MDT0000 00010000:00010000:2.0:1783947699.490988:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.490993:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947699.491004:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236188160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947699.491009:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947699.491012:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.491019:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947699.491024:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947699.491028:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947699.491030:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783947699.491032:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783947699.491047:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.491052:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947699.491058:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947699.491063:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947699.491068:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947699.491072:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.491074:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.491076:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.491080:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947699.491081:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947699.491112:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947699.491119:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236188416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.491176:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236188672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.491224:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947699.491230:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236188544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.491275:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188160 00000100:00100000:1.0:1783947699.491282:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188160 00000100:00100000:1.0:1783947699.491321:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188416 00000100:00100000:1.0:1783947699.491323:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188416 00000100:00100000:1.0:1783947699.491334:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188672 00000100:00100000:1.0:1783947699.491336:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188672 00000100:00100000:1.0:1783947699.491345:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188544 00000100:00100000:1.0:1783947699.491348:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188544 00000100:00100000:1.0:1783947699.491362:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947699.491370:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+26:3637:x1870604236188160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947699.491384:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947699.491399:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9be00/0xe6fd1fdb55501264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550125d expref: 26 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.491413:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947699.491445:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+25:3637:x1870604236188160:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.491452:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947699.491545:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947699.491552:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3637:x1870604236188416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947699.491560:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947699.491568:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55501669 expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.491577:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947699.491603:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:3637:x1870604236188416:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.491609:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947699.491622:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947699.491628:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:3640:x1870604236188672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947699.491634:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947699.491642:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55501256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550124f expref: 22 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.491650:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947699.491674:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3640:x1870604236188672:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.491679:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947699.491692:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947699.491698:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:3640:x1870604236188544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947699.491705:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947699.491713:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96e00/0xe6fd1fdb5550180d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55501806 expref: 20 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947699.491722:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947699.491740:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3640:x1870604236188544:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.491745:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947699.491774:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236188288:0@lo:39:umount.0 00000100:00100000:1.0:1783947699.491801:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.491849:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236188544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491857:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236188672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491893:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236188416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491912:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236188160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947699.491943:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188288 00000100:00100000:1.0:1783947699.491947:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188288 00000100:00100000:1.0:1783947699.491974:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947699.491980:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1870604236188288:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783947699.492008:0:17093:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501455 00000100:00080000:1.0:1783947699.492018:0:17093:0:(import.c:65:import_set_state_nolock()) ffff9e7bc7e0a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947699.492045:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1783947699.492175:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3636:x1870604236188288:12345-0@lo:39:umount.0 Request processed in 194us (372us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783947699.492181:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1783947699.492211:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783947699.492218:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236188288:0@lo:39:umount.0 00010000:00010000:1.0:1783947699.492230:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947699.494048:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783947699.494057:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1783947699.494078:0:20672:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783947699.494142:0:20672:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783947699.494169:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783947699.494191:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783947699.494194:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1783947699.494206:0:20672:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783947699.494259:0:20672:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783947699.494267:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783947699.494401:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e7ac66f0000) has no exports 00000100:00100000:1.0:1783947699.499585:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236188800:0@lo:9:umount.0 00000100:00100000:1.0:1783947699.499675:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.499723:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236188928:0@lo:9:umount.0 00000100:00100000:1.0:1783947699.499747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947699.499794:0:20439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188800 00000100:00100000:1.0:1783947699.499803:0:20439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188800 00000100:00100000:3.0:1783947699.499813:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236188928 00000100:00100000:3.0:1783947699.499817:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236188928 00000100:00100000:1.0:1783947699.500749:0:20439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947699.500764:0:20439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1870604236188800:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783947699.500800:0:20439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501520 00000100:00080000:1.0:1783947699.500819:0:20439:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34c9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947699.500883:0:20439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1783947699.501059:0:20439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3636:x1870604236188800:12345-0@lo:9:umount.0 Request processed in 300us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.501067:0:20439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947699.501085:0:20439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947699.501092:0:20439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1870604236188928:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783947699.501105:0:20439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501677 00000100:00080000:1.0:1783947699.501112:0:20439:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947699.501135:0:20439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1783947699.501202:0:20439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3636:x1870604236188928:12345-0@lo:9:umount.0 Request processed in 111us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947699.501208:0:20439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1783947699.501448:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947699.501518:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783947699.504728:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947699.504788:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783947699.505557:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783947699.508823:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947699.508841:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236188800:0@lo:9:umount.0 00000100:00080000:1.0:1783947699.508885:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783947699.509013:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783947699.509016:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947699.509021:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236188928:0@lo:9:umount.0 00000020:00080000:0.0:1783947699.522025:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e7ac66f0000) has no exports 00000020:00000080:0.0:1783947699.595606:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012aa 00000020:00000080:0.0:1783947699.595624:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac769b800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783947699.595689:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783947699.597308:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947699.597324:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947699.597328:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e7c01b88000) has no exports 00000020:00000080:0.0:1783947699.597992:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012a3 00000020:00000080:0.0:1783947699.598003:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bc4731000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783947699.598058:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac769b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783947699.604567:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc4731000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783947699.608247:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947699.608263:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783947699.608270:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bc4733000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783947699.608274:0:20672:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc4733000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783947699.608281:0:20672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1783947700.019757:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783947700.981820:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783947700.981834:0:17820:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1783947700.981840:0:17820:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783947700.981854:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00080000:3.0:1783947700.981860:0:17820:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1783947700.981862:0:17820:0:(genops.c:906:class_export_put()) final put ffff9e7bc51b0000/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00100000:3.0:1783947700.981866:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00080000:3.0:1783947700.981870:0:17820:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1783947700.981885:0:17820:0:(genops.c:906:class_export_put()) final put ffff9e7ac5824000/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00100000:3.0:1783947700.982168:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947700.982172:0:19409:0:(genops.c:906:class_export_put()) final put ffff9e7ac5bc7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783947700.982180:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000020:00000080:3.0:1783947700.982182:0:19409:0:(genops.c:906:class_export_put()) final put ffff9e7bf34c9000/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000020:00000080:1.0:1783947700.983592:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783947700.983682:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc51b0000/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e for lustre-MDT0001 00000020:00000080:1.0:1783947700.983707:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5824000/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba for lustre-MDT0001 00000020:00000080:1.0:1783947700.983789:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5bc7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783947700.983809:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bf34c9000/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba for lustre-OST0001 00000020:00000080:1.0:1783947700.983826:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc7e0a800 for lustre-MDT0001 00000020:00000080:1.0:1783947700.983831:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c01bf4800 for lustre-MDT0001 00000020:00000080:1.0:1783947700.983835:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5823800 for lustre-MDT0001 00000020:00000080:1.0:1783947700.983838:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5bc6000 for lustre-OST0001 00000020:00000080:1.0:1783947700.983842:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bf34ce800 for lustre-OST0001 00000001:00100000:1.0:1783947700.983925:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783947700.983930:0:17067:0:(genops.c:906:class_export_put()) final put ffff9e7bc9512800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783947700.983953:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00080000:1.0:1783947700.983963:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:1.0:1783947700.983966:0:17067:0:(genops.c:906:class_export_put()) final put ffff9e7bf34c8000/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00100000:1.0:1783947700.983971:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00080000:1.0:1783947700.983976:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1783947700.983978:0:17067:0:(genops.c:906:class_export_put()) final put ffff9e7ac5bc2800/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000020:00000080:3.0:1783947700.984017:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc9512800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783947700.984050:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bf34c8000/497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e for lustre-MDT0000 00000020:00000080:3.0:1783947700.984074:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5bc2800/bc51fa7f-2744-43d7-9883-dba4b4b8d1ba for lustre-MDT0000 00000020:00000080:3.0:1783947700.984104:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac769a800 for lustre-MDT0000 00000020:00000080:3.0:1783947700.984108:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bf34cb000 for lustre-MDT0000 00000020:00000080:3.0:1783947700.984113:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5bc1000 for lustre-MDT0000 00010000:00010000:2.0:1783947701.044122:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947701.493332:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236189056:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.493434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947701.493500:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236189184:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.493514:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236189568:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.493553:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947701.493570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947701.493574:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236190080:0@lo:400:kworker.0 00000100:00100000:1.0:1783947701.493600:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236189696:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.493607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947701.493640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947701.493660:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189056 00000100:00100000:0.0:1783947701.493669:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189056 00000100:00100000:0.0:1783947701.493722:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783947701.493731:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3637:x1870604236189056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.493782:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3637:x1870604236189056:12345-0@lo:400:kworker.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947701.493789:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783947701.493836:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236189056:0@lo:400:kworker.0 00000100:00100000:3.0:1783947701.493982:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189568 00000100:00100000:3.0:1783947701.493987:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189568 00000100:00100000:3.0:1783947701.494016:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190080 00000100:00100000:3.0:1783947701.494018:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190080 00000100:00100000:3.0:1783947701.494039:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189696 00000100:00100000:3.0:1783947701.494041:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189696 00000100:00100000:3.0:1783947701.494051:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783947701.494066:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236190080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947701.494112:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236190080:12345-0@lo:400:kworker.0 Request processed in 47us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947701.494118:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783947701.494132:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783947701.494135:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870604236189568:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783947701.494141:0:17087:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783947701.494166:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870604236189568:12345-0@lo:400:kworker.0 Request processed in 28us (612us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947701.494171:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783947701.494181:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783947701.494184:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1870604236189696:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783947701.494188:0:17087:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783947701.495874:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236189312:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.495936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947701.495970:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236189824:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.495992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947701.496007:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783947701.496012:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236189440:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.496029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947701.496048:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236189952:0@lo:400:kworker.0 00000100:00100000:0.0:1783947701.496066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947701.496106:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783947701.496112:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783947701.496116:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1783947701.504186:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189824 00000100:00100000:1.0:1783947701.504201:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189824 00000100:00100000:1.0:1783947701.504263:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189952 00000100:00100000:1.0:1783947701.504266:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189952 00000100:00100000:1.0:1783947701.504281:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947701.504292:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236189824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947701.504397:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236189824:12345-0@lo:400:kworker.0 Request processed in 107us (8403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947701.504421:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947701.504439:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947701.504443:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870604236189952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783947701.504450:0:18616:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783947701.504497:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1870604236189952:12345-0@lo:400:kworker.0 Request processed in 52us (8429us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783947701.504504:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1783947701.504661:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783947701.504667:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783947701.504678:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783947701.504684:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947701.504688:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 540 00000100:00080000:1.0:1783947701.504694:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947701.504726:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7be3fb2a00 x1870604236190336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947701.504752:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236189952:0@lo:400:kworker.0 00010000:00080000:1.0:1783947701.504769:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1180 x1870604236189824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947701.504779:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236189824:0@lo:400:kworker.0 00000100:00100000:1.0:1783947701.504823:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236190336:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783947701.504871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947701.504907:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190336 00000100:00100000:1.0:1783947701.504911:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190336 00000100:00100000:1.0:1783947701.504934:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947701.504939:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1870604236190336:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1783947701.504953:0:18616:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783947701.508504:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189184 00000100:00100000:2.0:1783947701.508523:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189184 00000100:00100000:3.0:1783947701.508782:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1870604236189696:12345-0@lo:400:kworker.0 Request processed in 14588us (15135us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947701.508794:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783947701.508838:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189312 00000100:00100000:3.0:1783947701.508843:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189312 00000100:00100000:3.0:1783947701.508895:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236189440 00000100:00100000:3.0:1783947701.508899:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236189440 00000100:00100000:3.0:1783947701.508927:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947701.508937:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236189312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947701.509024:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236189312:12345-0@lo:400:kworker.0 Request processed in 88us (13087us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947701.509031:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947701.509043:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783947701.509049:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236189440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947701.509100:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236189440:12345-0@lo:400:kworker.0 Request processed in 51us (13068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947701.509107:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1783947701.509150:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947701.509155:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947701.509158:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947701.509212:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236190208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947701.509253:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947701.509263:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1870604236189184:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783947701.509269:0:17092:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783947701.509381:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1870604236189184:12345-0@lo:400:kworker.0 Request processed in 116us (15812us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947701.509387:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947701.509771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947701.509820:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783947701.509825:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5581800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783947701.509829:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783947701.509835:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5581800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947701.509839:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1783947701.509845:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e7bc5581800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947701.509883:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3486680 x1870604236190464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947701.509906:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236189184:0@lo:400:kworker.0 00000100:00080000:2.0:1783947701.509920:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783947701.509923:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a22800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783947701.509933:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783947701.509937:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947701.509940:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1783947701.509944:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7be7a22800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947701.510002:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190208 00000100:00100000:3.0:1783947701.510008:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190208 00000100:00100000:3.0:1783947701.510052:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947701.510059:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236190208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947701.510086:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1783947701.510132:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236190208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947701.510139:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947701.510192:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3486300 x1870604236190592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947701.510205:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236189696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947701.510259:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236190208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947701.516168:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1870604236190336:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 11217us (11296us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783947701.516185:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947701.516265:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236189440:0@lo:400:kworker.0 00000100:00100000:1.0:1783947701.516281:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236189312:0@lo:400:kworker.0 00000100:00100000:1.0:1783947701.516325:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236190464:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783947701.518133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947701.519269:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947701.519281:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1783947701.519290:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e7ac77ce000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947701.519332:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a16a00 x1870604236190720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947701.519370:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236189568:0@lo:400:kworker.0 00010000:00080000:0.0:1783947701.519406:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c90000 x1870604236190080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947701.519416:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236190080:0@lo:400:kworker.0 00000100:00100000:1.0:1783947701.519599:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236190592:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783947701.519648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783947701.519680:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947701.519684:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947701.519687:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236190336:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783947701.519703:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236190720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783947701.519725:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947701.519767:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190592 00000100:00100000:1.0:1783947701.519774:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190592 00000100:00100000:1.0:1783947701.519807:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190720 00000100:00100000:1.0:1783947701.519810:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190720 00000100:00100000:1.0:1783947701.519828:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947701.519834:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236190592:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1783947701.519851:0:17089:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783947701.519906:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236190592:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 70us (257us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783947701.519920:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947701.519937:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783947701.519941:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236190720:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783947701.519949:0:17089:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783947701.519976:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236190720:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (249us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783947701.519981:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1783947701.520007:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947701.520011:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947701.520014:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236190720:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1783947701.520023:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a22800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947701.520026:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947701.520029:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236190592:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783947701.520338:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190464 00000100:00100000:3.0:1783947701.520353:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190464 00000100:00100000:3.0:1783947701.520388:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783947701.520394:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1870604236190464:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1783947701.520404:0:19080:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783947701.520444:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1870604236190464:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (2316us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783947701.520450:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1783947701.520595:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5581800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947701.520600:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947701.520603:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236190464:0@lo:38:ptlrpcd_00_01.0 00000020:01000000:2.0:1783947701.619944:0:20672:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac73e2ae0 - data ffff9e7beaf16510/ffff9e7ac156d000 00000020:01000000:2.0:1783947701.620134:0:20672:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac668d3c0 - data ffff9e7beaf150d8/ffff9e7c005bb800 00000001:00000004:2.0:1783947701.629673:0:20672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:3.0:1783947701.685883:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783947701.685892:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783947701.685907:0:20672:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e7bd9353b80 x1870604236188288/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783947709 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947701.685954:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783947701.689005:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783947701.689013:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1783947701.689035:0:20672:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947701.689156:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783947701.690624:0:17111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783947701.690632:0:17111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1783947701.690645:0:17111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1783947701.691340:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783947701.691345:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1783947701.691359:0:20672:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947701.691361:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783947701.691833:0:17113:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783947701.691837:0:17113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1783947701.691846:0:17113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1783947701.693284:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501272 00000020:00000080:1.0:1783947701.693291:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd1522800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783947701.694819:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501287 00000020:00000080:1.0:1783947701.694830:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd1525800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.694883:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1522800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783947701.694944:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783947701.694949:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947701.694957:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783947701.694961:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e7ac66f3380) has no exports 00000004:01000000:1.0:1783947701.695137:0:20672:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783947701.695145:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012e9 00000020:00000080:1.0:1783947701.695149:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.695253:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1525800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783947701.695313:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783947701.695316:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947701.695322:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947701.695324:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9e7bf3fb19c0) has no exports 00000020:00000080:1.0:1783947701.695330:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012e2 00000020:00000080:1.0:1783947701.695333:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783947701.695501:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1783947701.698638:0:20672:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783947701.698647:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783947701.698651:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1783947701.698658:0:20672:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947701.698660:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947701.699232:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783947701.700085:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947701.700099:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947701.700106:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012d4 00000020:00000080:1.0:1783947701.700116:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.700183:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc47c4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783947701.700191:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.700193:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783947701.700199:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783947701.700902:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783947701.700910:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947701.700917:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947701.700921:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9e7c01b8cd40) has no exports 00000020:00000080:1.0:1783947701.700928:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012cd 00000020:00000080:1.0:1783947701.700933:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd10bf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783947701.701193:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783947701.701200:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd10bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783947701.701682:0:20672:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783947701.701687:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783947701.701701:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1783947701.701706:0:20672:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947701.701708:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783947701.701974:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947701.701981:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783947701.701994:0:20672:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783947701.701999:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012bf 00000020:00000080:1.0:1783947701.702004:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac7698000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.702727:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bd10ba800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783947701.702737:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7ac7699000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.702874:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7699000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783947701.702881:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783947701.703108:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783947701.703115:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947701.703122:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947701.703125:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e7bf3fb4d40) has no exports 00000020:00000080:1.0:1783947701.703131:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555012b8 00000020:00000080:1.0:1783947701.703136:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7c003f8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783947701.703159:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7698000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:0.0:1783947701.704578:0:20672:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783947701.704585:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783947701.704589:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783947701.704596:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947701.704731:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947701.704749:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947701.704778:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947701.704782:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947701.704787:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd1520800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783947701.704791:0:20672:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1520800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783947701.704797:0:20672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947701.704901:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550128e 00000020:00000080:0.0:1783947701.704908:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd1521800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783947701.704912:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783947701.704915:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947701.704918:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947701.704921:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e7bc5510000) has no exports 00000020:00000080:0.0:1783947701.704939:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947701.704941:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783947701.704945:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501295 00000020:00000080:0.0:1783947701.704949:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd1524800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783947701.705010:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c003f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783947701.705018:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c003f9000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783947701.705024:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7bd10bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947701.705036:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd10bc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783947701.705039:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783947701.705084:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1521800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783947701.705086:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7bd1526000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783947701.705096:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1526000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783947701.705099:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783947701.705121:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1524800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783947701.705211:0:20672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7ac7ff8000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783947701.705215:0:20672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7ff8000 3 00000020:01000004:0.0:1783947701.705218:0:20672:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7ac7ff8000 from lustre-MDT0000 00000020:00000080:0.0:1783947701.705234:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947701.705238:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783947701.705240:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7bd1527000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783947701.705242:0:20672:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1527000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783947701.705248:0:20672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783947701.705275:0:20672:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783947701.705278:0:20672:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783947701.705280:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783947701.705282:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947701.705285:0:20672:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947701.705291:0:20672:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e7bc48d7000 c5bf4e70-0b4f-4c54-b791-4147365ffdfe 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947701.705296:0:20672:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e7ac66f19c0) has exports, disconnecting them 00000020:00080000:0.0:1783947701.705300:0:20672:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e7bc48d7000), last request at 1783947607 00000020:00000080:0.0:1783947701.705322:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550123a 00000020:00010000:0.0:1783947701.705325:0:20672:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7bc48d7000: total 0 00000100:00080000:0.0:1783947701.705329:0:20672:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783947701.705592:0:20672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bc48d7000): rc 0 00000020:00080000:0.0:1783947701.705598:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e7ac66f19c0) has no exports 00000100:00100000:0.0:1783947701.705665:0:17082:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e7ac74fea00:17082] 2 exiting: rc = 0 00000100:00100000:0.0:1783947701.705769:0:17081:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e7ac74ffa00:17081] 1 exiting: rc = 0 00000100:00100000:0.0:1783947701.705872:0:17080:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e7ac74ff000:17080] 0 exiting: rc = 1 00000100:00100000:0.0:1783947701.705928:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705935:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705940:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705945:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705951:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705957:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705963:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705967:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705980:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705985:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705990:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.705999:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706004:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706009:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706014:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706019:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706024:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706032:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706037:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706042:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706047:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706052:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706057:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706063:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706068:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706072:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706077:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706081:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706086:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706091:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706097:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706102:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706107:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706112:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706117:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706122:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706127:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706132:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706136:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706141:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706146:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706150:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706155:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706165:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706170:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706176:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706181:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706185:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706191:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706196:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706201:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706205:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706210:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706216:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706221:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706225:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706230:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706235:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706240:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706245:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706249:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706254:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706258:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947701.706263:0:20672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1783947701.713688:0:17075:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7bc48d7000: total 0 00010000:00010000:3.0:1783947701.713766:0:17075:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7bc48d7000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783947701.713805:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb5550149b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55501494 expref: 14 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713826:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55000/0xe6fd1fdb555015f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555015f2 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713843:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb555017e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555017dc expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713853:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846b400/0xe6fd1fdb55501359 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55501352 expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713879:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb555014c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555014be expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713890:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb555017f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555017ea expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713899:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55501416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550140f expref: 8 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713908:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846a600/0xe6fd1fdb55501367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55501360 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713919:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e51800/0xe6fd1fdb55501623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550161c expref: 6 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713946:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb55501248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55501241 expref: 5 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713956:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb555017ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555017f8 expref: 4 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713968:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e51a00/0xe6fd1fdb55501375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550136e expref: 3 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.713991:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb55501662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb5550165b expref: 2 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947701.714005:0:17075:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7bc48d7000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783947701.714026:0:17075:0:(genops.c:906:class_export_put()) final put ffff9e7bc48d7000/c5bf4e70-0b4f-4c54-b791-4147365ffdfe 00010000:00010000:3.0:1783947701.714037:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947701.714040:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947701.714042:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783947701.714114:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc48d7000/c5bf4e70-0b4f-4c54-b791-4147365ffdfe for MGS 00000020:00000080:0.0:1783947701.714149:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc48d0000 for MGS 00000020:01000000:0.0:1783947701.714314:0:20672:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac5872000 - data ffff9e7beac43948/ffff9e7bf34ee400 00000020:01000000:0.0:1783947701.717289:0:20672:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac668d8a0 - data ffff9e7beac80798/ffff9e7ac6576400 00000020:00000080:0.0:1783947701.718271:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550121e 00000020:00000080:0.0:1783947701.718281:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac7ffc800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783947701.718298:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7ffc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783947701.718309:0:20672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7ac7ff8000 from MGS, refs=2 00000020:01000004:0.0:1783947701.718312:0:20672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7ff8000 2 00000020:01000004:0.0:1783947701.718315:0:20672:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7ac7ff8000 from MGS 00000020:00000080:0.0:1783947701.718336:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947701.720922:0:20672:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783947701.720934:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac7ffd800/MGS 00000020:00000080:0.0:1783947701.720953:0:20672:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7ffd800/MGS for MGS 00000020:01000000:0.0:1783947701.720962:0:20672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783947701.721107:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783947701.721112:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947701.721121:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947701.721128:0:20672:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e7c01bf1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947701.721134:0:20672:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9e7bf3fb3380) has exports, disconnecting them 00000020:00080000:0.0:1783947701.721139:0:20672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e7c01bf1800), last request at 1783947608 00000020:00000080:0.0:1783947701.721143:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501321 00000020:00080000:0.0:1783947701.721157:0:20672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7c01bf1800): rc 0 00000020:00000080:0.0:1783947701.721162:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7c01bf1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783947701.721240:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01bf1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783947701.738596:0:20672:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783947701.738608:0:20672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947701.738614:0:20672:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783947701.738624:0:20672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947701.738664:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c01bf0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783947701.738850:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947701.738868:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783947701.738873:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7c01bf4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783947701.738877:0:20672:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01bf4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783947701.738884:0:20672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783947701.738977:0:20672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7ff8000 1 00000020:00000080:3.0:1783947701.738983:0:20672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501210 00000020:00000080:3.0:1783947701.738992:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac7ffb000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783947701.739001:0:20672:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783947701.739010:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7ffb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783947701.739022:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947701.739284:0:20672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783947701.739290:0:20672:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e7ac66f4d40) has no exports 00000020:00000080:3.0:1783947701.886336:0:20672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947701.886349:0:20672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783947701.886356:0:20672:0:(genops.c:906:class_export_put()) final put ffff9e7ac7ff9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783947701.886360:0:20672:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7ff9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783947701.886372:0:20672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783947701.886511:0:20672:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7ac7fff000 00000020:02000400:3.0:1783947701.886566:0:20672:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783947702.074085:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947703.092879:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947704.115938:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947704.440128:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947704.564540:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947704.564565:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236190848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947704.564637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947704.565126:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190848 00000100:00100000:3.0:1783947704.565134:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190848 00000100:00100000:3.0:1783947704.565226:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947704.565244:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236190848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947704.565276:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947704.565333:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236190848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947704.565341:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947704.565404:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236190848:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783947704.566060:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783947705.140761:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783947705.348643:0:20873:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783947705.360764:0:20873:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1783947705.360835:0:20873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.360850:0:20873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.360858:0:20873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.360866:0:20873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.360925:0:20873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783947705.360931:0:20873:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783947705.360954:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947705.360969:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783947705.360976:0:20873:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947705.360982:0:20873:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783947705.360987:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947705.360988:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783947705.360992:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783947705.361886:0:20873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.361900:0:20873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.361906:0:20873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.361912:0:20873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363244:0:20673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947705.363257:0:20673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363267:0:20673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947705.363364:0:20673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363376:0:20673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947705.363383:0:20673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947705.363389:0:20673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947705.363403:0:20673:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783947705.363406:0:20673:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783947705.363441:0:20673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363447:0:20673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947705.363560:0:20673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363567:0:20673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363578:0:20673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947705.363582:0:20673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363588:0:20673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947705.363590:0:20673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363597:0:20673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947705.363603:0:20673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947705.363608:0:20673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947705.363610:0:20673:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1783947705.363620:0:20673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363626:0:20673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947705.363650:0:20673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947705.363657:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947705.363659:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947705.363661:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947705.363679:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236191104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947705.363747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947705.363823:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236191104 00000100:00100000:2.0:1783947705.363830:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236191104 00000100:00100000:2.0:1783947705.363863:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947705.363871:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1870604236191104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783947705.363877:0:17074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947705 with bad export cookie 16644494824720831034 00000100:00100000:3.0:1783947705.364394:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236190976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947705.364426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947705.364545:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236190976 00000100:00100000:1.0:1783947705.364551:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236190976 00000100:00100000:1.0:1783947705.364576:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947705.364582:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1870604236190976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783947705.364587:0:17073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947705 with bad export cookie 16644494824720831034 00000100:00100000:1.0:1783947705.364637:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1870604236190976:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (210us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783947705.364644:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783947705.364677:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783947705.364681:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783947705.364684:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1783947705.367082:0:20873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783947705.367098:0:20873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367121:0:20873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367130:0:20873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367138:0:20873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367166:0:20873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367185:0:20873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947705.367196:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947705.367202:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367210:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947705.367214:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.367223:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947705.367230:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947705.367236:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947705.367238:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1783947705.367241:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783947705.367296:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947705.372545:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1870604236191104:12345-0@lo:103:ldlm_bl.0 Request processed in 8665us (8790us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947705.372560:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783947705.372610:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783947705.381425:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.103@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783947705.381450:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783947705.381502:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf3485880 x1870604236191104/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947721 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947705.381517:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf3487800 x1870604236190976/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947721 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783947705.381526:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783947705.381528:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783947705.381530:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1783947705.381847:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381859:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947705.381886:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381894:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381922:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947705.381924:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947705.381927:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947705.381944:0:20873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381953:0:20873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381960:0:20873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381966:0:20873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381983:0:20873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947705.381989:0:20873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.381995:0:20873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382001:0:20873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382007:0:20873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382016:0:20873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783947705.382024:0:20873:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1783947705.382029:0:20873:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1783947705.382063:0:20873:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1783947705.382068:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1783947705.382072:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947705.382078:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783947705.382083:0:20873:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e7bc4730000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947705.382089:0:20873:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e7bc51b6800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947705.382095:0:20873:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9e7be7b40000) has exports, disconnecting them 00000020:00080000:0.0:1783947705.382099:0:20873:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e7bc4730000), last request at 1783947701 00000020:00000080:0.0:1783947705.382107:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550164d 00000100:00080000:0.0:1783947705.382125:0:20873:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4732800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783947705.382156:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947705.382161:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382168:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ba00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947705.382171:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382179:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947705.382186:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947705.382192:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783947705.382195:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783947705.382196:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783947705.382206:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:0.0:1783947705.382213:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382219:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382227:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947705.382230:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382236:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947705.382239:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382245:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947705.382251:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947705.382255:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947705.382257:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783947705.382259:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783947705.382263:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:0.0:1783947705.382265:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947705.382347:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:0:1870604236191232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947705.382378:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947705.382401:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947705.382415:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947705.382420:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947705.382422:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783947705.382435:0:20873:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bc4730000): rc 0 00000020:00000080:0.0:1783947705.382438:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bc4730000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1783947705.382476:0:20873:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e7bc51b6800), last request at 1783947701 00000020:00000080:0.0:1783947705.382480:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555014ef 00000100:00080000:0.0:1783947705.382485:0:20873:0:(import.c:65:import_set_state_nolock()) ffff9e7bc51b1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783947705.382493:0:20873:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bc51b6800): rc 0 00000020:00000080:0.0:1783947705.382495:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bc51b6800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1783947705.382503:0:20873:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb7948191fae0 00000100:00080000:0.0:1783947705.382521:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947705.382525:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:3.0:1783947705.383393:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc4730000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783947705.383453:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc51b6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783947705.383499:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc4732800 for lustre-MDT0001 00000020:00000080:3.0:1783947705.383503:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc51b1000 for lustre-MDT0001 00010000:00010000:3.0:1783947705.383513:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947705.383675:0:20873:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947705.383680:0:20873:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5581800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783947705.383920:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783947705.383924:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1783947705.383942:0:20873:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783947705.384010:0:20873:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783947705.384037:0:20873:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783947705.384057:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783947705.384059:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1783947705.384065:0:20873:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783947705.384129:0:20873:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783947705.384136:0:20873:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783947705.384173:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e7be7b40000) has no exports 00000100:00100000:0.0:1783947705.384499:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236191360:0@lo:9:umount.0 00000100:00100000:0.0:1783947705.384579:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947705.384609:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236191488:0@lo:9:umount.0 00000100:00100000:0.0:1783947705.384646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947705.384759:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236191360 00000100:00100000:3.0:1783947705.384767:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236191360 00000100:00100000:3.0:1783947705.384816:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236191488 00000100:00100000:3.0:1783947705.384820:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236191488 00000100:00100000:3.0:1783947705.384849:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947705.384857:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870604236191360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783947705.384886:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501519 00000100:00080000:3.0:1783947705.384893:0:18595:0:(import.c:65:import_set_state_nolock()) ffff9e7be78bf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947705.384928:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783947705.385054:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3636:x1870604236191360:12345-0@lo:9:umount.0 Request processed in 198us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947705.385062:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947705.385077:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947705.385082:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870604236191488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783947705.385092:0:18595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550167e 00000100:00080000:3.0:1783947705.385097:0:18595:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947705.385114:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1783947705.385186:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3636:x1870604236191488:12345-0@lo:9:umount.0 Request processed in 103us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947705.385192:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1783947705.385216:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947705.385222:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947705.385255:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783947705.385265:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783947705.385266:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947705.385270:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236191360:0@lo:9:umount.0 00000100:00080000:3.0:1783947705.385360:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783947705.385368:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783947705.385369:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947705.385372:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236191488:0@lo:9:umount.0 00000100:00080000:2.0:1783947705.385670:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e7bc48d4800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1783947705.385684:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236191104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947705.385706:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947705.385713:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947705.386063:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947705.386070:0:3640:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 493 00000100:00080000:1.0:1783947705.386077:0:3640:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7bc48d4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947705.386110:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7be3fb1880 x1870604236191616/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947705.386157:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3636:1870604236191616:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1783947705.386189:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604236191616 offset 0 length 520: 4 00000100:00100000:1.0:1783947705.386236:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236190976:0@lo:103:ldlm_bl.0 00000001:00100000:0.0:1783947705.387107:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783947705.387113:0:18589:0:(genops.c:906:class_export_put()) final put ffff9e7be78ba800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783947705.387173:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783947705.387176:0:18589:0:(genops.c:906:class_export_put()) final put ffff9e7bf34cd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947705.387426:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be78ba800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783947705.387494:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be78bf800 for lustre-OST0000 00000020:00000080:3.0:1783947705.387707:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bf34cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783947705.387816:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bf34c9800 for lustre-OST0000 00000020:00080000:1.0:1783947705.392925:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e7be7b40000) has no exports 00000020:01000000:0.0:1783947705.439877:0:20873:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac168de40 - data ffff9e7bd1c435e8/ffff9e7bf7a27800 00000020:01000000:0.0:1783947705.440038:0:20873:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac7288360 - data ffff9e7beae13948/ffff9e7c007de000 00000001:00000004:0.0:1783947705.449623:0:20873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1783947705.485305:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947705.485314:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783947705.485322:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783947705.486811:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783947705.486817:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783947705.486836:0:20873:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947705.486839:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783947705.487040:0:17828:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783947705.487045:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1783947705.487057:0:17828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1783947705.489211:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783947705.489218:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783947705.489240:0:20873:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947705.489243:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783947705.489733:0:17830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783947705.489739:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1783947705.489751:0:17830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1783947705.490690:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501383 00000020:00000080:3.0:1783947705.490700:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77ce800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783947705.492681:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501398 00000020:00000080:3.0:1783947705.492700:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77c8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783947705.492709:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1783947705.492715:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947705.492740:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783947705.492745:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e7ac779b380) has no exports 00000004:01000000:3.0:1783947705.492925:0:20873:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783947705.492935:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013ec 00000020:00000080:3.0:1783947705.492940:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bd1b6b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783947705.492944:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783947705.492948:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947705.492952:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783947705.492955:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e7be7b44d40) has no exports 00000020:00000080:3.0:1783947705.492963:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013e5 00000020:00000080:3.0:1783947705.492966:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bd1b6e000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1783947705.493553:0:20873:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783947705.493558:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783947705.493563:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1783947705.493570:0:20873:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947705.493573:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947705.493614:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947705.493620:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947705.493625:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013d7 00000020:00000080:3.0:1783947705.493630:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77ca800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783947705.493634:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783947705.493637:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947705.493640:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783947705.493642:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9e7be7b419c0) has no exports 00000020:00000080:3.0:1783947705.493646:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013d0 00000020:00000080:3.0:1783947705.493648:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77cd800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1783947705.493991:0:20873:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783947705.493994:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783947705.493997:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1783947705.494000:0:20873:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947705.494001:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947705.494024:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947705.494036:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1783947705.494053:0:20873:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783947705.494058:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013bb 00000020:00000080:3.0:1783947705.494064:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77c9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783947705.494069:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1783947705.494072:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947705.494076:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783947705.494078:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9e7bc55119c0) has no exports 00000020:00000080:1.0:1783947705.494168:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77ce800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783947705.494236:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77c8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1783947705.494244:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1b6b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783947705.494250:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd1b6e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783947705.494256:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bd1b69800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783947705.494262:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7ac77cc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783947705.494264:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77cc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1783947705.494282:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783947705.494369:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77ca800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783947705.494374:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77cd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783947705.494384:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc5586000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783947705.494388:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7ac77ca000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783947705.494390:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77ca000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1783947705.494393:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783947705.494431:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77c9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783947705.494656:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013b4 00000020:00000080:3.0:1783947705.494661:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bc5584800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783947705.495211:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc5584800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1783947705.499712:0:20873:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1783947705.499722:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947705.499727:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783947705.499735:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947705.499805:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947705.499818:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947705.499861:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947705.499866:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947705.499872:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783947705.499876:0:20873:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783947705.499884:0:20873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947705.500060:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550139f 00000020:00000080:0.0:1783947705.500068:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77cf000/lustre-MDD0001_UUID 00000020:01000000:0.0:1783947705.500074:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1783947705.500078:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947705.500093:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947705.500099:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e7be7b43380) has no exports 00000020:00000080:0.0:1783947705.500121:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947705.500124:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1783947705.500128:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555013a6 00000020:00000080:0.0:1783947705.500133:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77cd000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1783947705.500142:0:20873:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bff95d000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1783947705.500145:0:20873:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff95d000 2 00000020:01000004:0.0:1783947705.500148:0:20873:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7bff95d000 from lustre-MDT0001 00000020:00000080:0.0:1783947705.500163:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947705.500166:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1783947705.500168:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac77c8800/lustre-MDT0001_UUID 00000020:00000080:0.0:1783947705.500170:0:20873:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77c8800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1783947705.500177:0:20873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1783947705.500204:0:20873:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1783947705.500208:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1783947705.500210:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947705.500213:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947705.500219:0:20873:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e7ac674f000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947705.500224:0:20873:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9e7be3f30000) has exports, disconnecting them 00000020:00080000:0.0:1783947705.500228:0:20873:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e7ac674f000), last request at 1783947622 00000020:00000080:0.0:1783947705.500231:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501424 00000020:00080000:0.0:1783947705.500244:0:20873:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac674f000): rc 0 00000020:00000080:0.0:1783947705.500247:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac674f000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783947705.500978:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc5581800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783947705.500987:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7bc5587000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783947705.500989:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc5587000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1783947705.500995:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783947705.501095:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77cf000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1783947705.501099:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7ac77cb800/lustre-MDD0001_UUID 00000020:00000080:1.0:1783947705.501101:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77cb800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1783947705.501105:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1783947705.501224:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77cd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783947705.501230:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac674f000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1783947705.527039:0:20873:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1783947705.527049:0:20873:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947705.527054:0:20873:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783947705.527062:0:20873:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783947705.527143:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac77ce000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1783947705.527374:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947705.527385:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1783947705.527391:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7ac6748000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1783947705.527408:0:20873:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac6748000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1783947705.527417:0:20873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1783947705.527523:0:20873:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff95d000 1 00000020:00000080:0.0:1783947705.527531:0:20873:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550134b 00000020:00000080:0.0:1783947705.527539:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bc51b5000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1783947705.527551:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1783947705.527556:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947705.527562:0:20873:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947705.527566:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9e7ac77999c0) has no exports 00000020:00000080:1.0:1783947705.527708:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc51b5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783947705.572112:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947705.572129:0:20873:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1783947705.572135:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bff95b000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783947705.572141:0:20873:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bff95b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1783947705.572153:0:20873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1783947705.572432:0:20873:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7bff95c800 00000020:01000000:1.0:1783947705.572654:0:20873:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783947705.572660:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947705.572666:0:20873:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783947705.572670:0:20873:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e7ac779cd40) has no exports 00000100:00100000:3.0:1783947705.572998:0:17089:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e7be781ba00:17089] 2 exiting: rc = 0 00000100:00100000:0.0:1783947705.573141:0:18616:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e7ac666ae00:18616] 3 exiting: rc = 0 00000100:00100000:0.0:1783947705.573246:0:17087:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e7be7871200:17087] 0 exiting: rc = 1 00000100:00100000:2.0:1783947705.573370:0:17088:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e7c01ca2c00:17088] 1 exiting: rc = 0 00000100:00100000:1.0:1783947705.573891:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573899:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573905:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573911:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573917:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573922:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573926:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573932:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573937:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573943:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573949:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573958:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573963:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573968:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573974:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573979:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573984:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573991:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.573996:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574001:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574009:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574015:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574020:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574026:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574031:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574036:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574042:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574047:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574055:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574061:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574067:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574075:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574080:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574086:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574092:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574114:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574121:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574127:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574134:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574140:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574145:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574150:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574155:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574160:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574165:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574170:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574175:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574180:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574185:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574190:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574196:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574201:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574206:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574211:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574216:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574222:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574227:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574233:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574239:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574244:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574249:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574255:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574260:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.574384:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947705.578579:0:17091:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e7be781b200:17091] 1 exiting: rc = 0 00000100:00100000:2.0:1783947705.579008:0:17090:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e7be781a400:17090] 0 exiting: rc = 1 00000100:00100000:1.0:1783947705.579166:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579175:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579181:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579188:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579193:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579198:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579221:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579227:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579233:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579238:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579243:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579247:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579252:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579256:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579261:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579327:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579335:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579340:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579345:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579350:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579355:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579360:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579365:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579370:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579376:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579382:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579387:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579392:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579397:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579402:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579407:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579413:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579418:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579422:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579427:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579432:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579437:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579442:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579448:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579520:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579528:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579543:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579548:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579553:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579558:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579563:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579567:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579572:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579577:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579581:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579586:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579590:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579595:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579600:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579604:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579608:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579613:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579618:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579623:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579628:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579633:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579638:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579643:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.579648:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947705.580439:0:17093:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e7ac73d0400:17093] 1 exiting: rc = 0 00000100:00100000:1.0:1783947705.582147:0:17092:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e7bc3692200:17092] 0 exiting: rc = 1 00000100:00100000:3.0:1783947705.582528:0:19080:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e7ac666a200:19080] 2 exiting: rc = 0 00000100:00100000:1.0:1783947705.582653:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582662:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582667:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582674:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582679:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582685:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582691:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582697:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582703:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582709:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582715:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582742:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582761:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582768:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582773:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582779:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582794:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582801:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582807:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582813:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582820:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582825:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582832:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582838:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582857:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582863:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582869:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582875:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582880:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582886:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582892:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582898:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582904:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582910:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582916:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582922:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582939:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582946:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582952:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582958:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582963:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582969:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582975:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582980:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582986:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.582992:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583002:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583008:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583026:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583033:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583041:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583048:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583055:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583062:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583068:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583074:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583080:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583086:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583091:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583097:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583115:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583122:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583127:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.583133:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947705.592635:0:17094:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e7ac73d0e00:17094] 0 exiting: rc = 1 00000100:00100000:2.0:1783947705.592952:0:17095:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e7bc3693600:17095] 1 exiting: rc = 0 00000100:00100000:1.0:1783947705.593050:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593057:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593063:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593067:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593072:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593077:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593082:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593086:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593092:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593097:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593102:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593107:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593112:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593118:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593123:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593128:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593132:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593149:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593154:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593159:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593165:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593169:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593175:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593180:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593185:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593189:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593194:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593198:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593202:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593206:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593212:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593217:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593222:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593227:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593232:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593237:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593243:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593248:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593253:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593257:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593263:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593336:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593344:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593349:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593354:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593359:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593364:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593369:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593374:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593379:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593383:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593388:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593403:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593408:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593413:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593418:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593422:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593427:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593431:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593435:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593439:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593444:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593449:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.593591:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947705.594198:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e7ac70d1a00:17097] 1 exiting: rc = 0 00000100:00100000:2.0:1783947705.594422:0:17096:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e7bd0981e00:17096] 0 exiting: rc = 1 00000100:00100000:1.0:1783947705.594563:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594570:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594575:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594579:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594585:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594590:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594595:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594601:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594606:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594610:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594616:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594620:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594625:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594630:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594635:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594639:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594644:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594648:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594652:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594656:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594661:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594665:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594669:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594687:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594691:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594696:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594700:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594705:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594710:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594714:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594719:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594723:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594728:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594744:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594751:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594757:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594762:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594767:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594772:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594777:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594781:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594797:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594803:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594808:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594813:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594818:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594823:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594829:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594834:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594839:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594843:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594848:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594853:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594858:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594863:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594867:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594871:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594876:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594889:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594894:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594900:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594905:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594910:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.594915:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947705.595408:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e7bf7ef0400:17098] 0 exiting: rc = 1 00000100:00100000:3.0:1783947705.595556:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e7ac70d1000:17099] 1 exiting: rc = 0 00000100:00100000:1.0:1783947705.595659:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595666:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595670:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595675:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595680:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595685:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595690:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595694:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595699:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595704:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595709:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595713:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595718:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595722:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595799:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595805:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595810:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595815:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595820:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595826:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595831:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595836:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595841:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595846:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595851:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595857:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595863:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595868:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595872:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595887:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595893:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595899:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595904:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595908:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595913:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595918:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595922:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595927:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595932:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595936:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595941:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595945:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595949:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595954:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595959:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595963:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595968:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595973:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595978:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595983:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595987:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595992:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.595996:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596001:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596005:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596010:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596015:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596021:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596025:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596031:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596035:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596040:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596045:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.596050:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947705.596831:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e7ac70d1600:17100] 0 exiting: rc = 1 00000100:00100000:2.0:1783947705.597031:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e7ac70d1400:17102] 2 exiting: rc = 0 00000100:00100000:3.0:1783947705.597401:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e7ac70d0200:17101] 1 exiting: rc = 0 00000100:00100000:1.0:1783947705.597740:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597749:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597755:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597760:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597765:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597770:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597776:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597781:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597796:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597802:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597808:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597813:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597818:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597825:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597830:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597835:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597840:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597863:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597870:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597876:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597881:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597889:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597894:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597899:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597904:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597910:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597915:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597920:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597925:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597929:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597934:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597941:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597948:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597953:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597958:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597973:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597978:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597984:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597990:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.597995:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598001:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598026:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598032:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598037:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598042:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598048:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598053:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598058:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598064:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598070:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598075:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598081:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598086:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598091:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598096:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598100:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598105:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598110:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598120:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598126:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598132:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598141:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598147:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947705.598153:0:20873:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783947705.602961:0:20873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947705.602976:0:20873:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783947705.602982:0:20873:0:(genops.c:906:class_export_put()) final put ffff9e7bc48d6000/MDS_uuid 00000020:00000080:1.0:1783947705.602988:0:20873:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc48d6000/MDS_uuid for MDS 00000020:01000000:1.0:1783947705.602999:0:20873:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783947705.603154:0:20873:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1783947706.164316:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947706.611686:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947706.611700:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783947706.611703:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947706.611708:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783947706.611713:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947706.611723:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1783947706.611731:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783947706.611740:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7be7a22800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947706.611821:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7be3fb0e00 x1870604236191744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947706.611878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947706.611882:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783947706.611884:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947706.611888:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1783947706.611892:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783947706.611896:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947706.611908:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7be3fb1c00 x1870604236192000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947706.611951:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236191872:0@lo:400:kworker.0 00000400:00000100:1.0:1783947706.612025:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236191872 offset 0 length 224: 4 00000100:00100000:1.0:1783947706.612073:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947706.612078:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236192128:0@lo:400:kworker.0 00000400:00000100:1.0:1783947706.612095:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192128 offset 0 length 224: 4 00000100:00100000:3.0:1783947706.613894:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236191744:0@lo:38:kworker.0 00000400:00000100:3.0:1783947706.613961:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236191744 offset 0 length 520: 4 00000100:00100000:3.0:1783947706.613997:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236192000:0@lo:38:kworker.0 00000400:00000100:3.0:1783947706.614015:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192000 offset 0 length 520: 4 00010000:00010000:0.0:1783947707.188575:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947708.211628:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947709.237294:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783947709.349073:0:21074:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783947709.362013:0:21074:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783947709.362072:0:21074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947709.362088:0:21074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947709.362096:0:21074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947709.362104:0:21074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947709.362137:0:21074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783947709.362143:0:21074:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1783947709.362162:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947709.362171:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947709.362173:0:21074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1783947709.362182:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947709.362188:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947709.362189:0:21074:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7be3fb0e00 x1870604236191744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783947709.362208:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947709.362216:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947709.362222:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783947709.362224:0:21074:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:01000000:2.0:1783947709.362225:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783947709.362228:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1783947709.362234:0:21074:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783947709.362241:0:21074:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a22800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1783947709.362245:0:17075:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00000100:00080000:1.0:1783947709.362248:0:21074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1783947709.362250:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947709.362255:0:21074:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7be3fb0e00 x1870604236191744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947721 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783947709.362260:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947709.362276:0:21074:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:2.0:1783947709.362280:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947709.362281:0:21074:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:2.0:1783947709.362283:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947709.362287:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947709.362512:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236191744:0@lo:38:kworker.0 00000100:00080000:3.0:1783947709.364063:0:21074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783947709.364076:0:21074:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7be3fb0a80 x1870604236191872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947722 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947709.364323:0:21074:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783947709.364329:0:21074:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783947709.364352:0:21074:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a23800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783947709.365562:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236192256:0@lo:39:umount.0 00000400:00000100:1.0:1783947709.365623:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192256 offset 0 length 224: 4 00000100:00100000:0.0:1783947709.366721:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236191872:0@lo:400:kworker.0 00010000:00010000:2.0:1783947710.259559:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947710.643823:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783947710.643834:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947710.643837:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783947710.643840:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783947710.644025:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236192384:0@lo:400:kworker.0 00000400:00000100:2.0:1783947710.644104:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192384 offset 0 length 224: 4 00000001:00100000:3.0:1783947710.715101:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783947710.715113:0:19409:0:(genops.c:906:class_export_put()) final put ffff9e7ac5bc6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783947710.715188:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5bc6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783947710.715239:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5bc4000 for lustre-OST0001 00010000:00010000:3.0:1783947711.283793:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947711.668572:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947711.668583:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947711.668586:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947711.668589:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947711.668715:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236192512:0@lo:400:kworker.0 00000400:00000100:3.0:1783947711.668771:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192512 offset 0 length 224: 4 00010000:00010000:2.0:1783947712.307630:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947713.331629:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947714.357874:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947715.380081:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947715.507611:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947705/real 1783947705] req@ffff9e7be3fb1880 x1870604236191616/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783947715 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947715.507668:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7be3fb1880 x1870604236191616/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783947715 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783947715.507695:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947715.507733:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1783947715.507738:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3636:1870604236191616:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1783947715.507865:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947715.507870:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783947715.507873:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947715.507878:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 590 00000100:00080000:2.0:1783947715.507883:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783947715.507890:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7bc48d4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947715.507930:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3485880 x1870604236192640/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947715.507948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947715.507951:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947715.508014:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947715.508034:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236192768:0@lo:400:kworker.0 00000400:00000100:0.0:1783947715.508091:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192768 offset 0 length 224: 4 00000100:00100000:1.0:1783947715.508163:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3636:1870604236192640:0@lo:250:kworker.0 00000400:00000100:1.0:1783947715.508190:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604236192640 offset 0 length 520: 4 00010000:00010000:2.0:1783947716.406001:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947717.427772:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947718.451780:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947719.475722:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947719.603579:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947709/real 1783947709] req@ffff9e7bd9350000 x1870604236192256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947719.603622:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bd9350000 x1870604236192256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783947719.603641:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a23800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783947719.603661:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236192256:0@lo:39:umount.0 00000100:00080000:3.0:1783947719.603821:0:21074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783947719.603827:0:21074:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783947719.603832:0:21074:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783947719.604727:0:21074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604741:0:21074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604748:0:21074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604755:0:21074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604784:0:21074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947719.604805:0:21074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604812:0:21074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604818:0:21074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604823:0:21074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947719.604846:0:21074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783947719.604851:0:21074:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783947719.604875:0:21074:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783947719.604879:0:21074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1783947719.604884:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947719.604889:0:21074:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783947719.604894:0:21074:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e7bc5514d40) has no exports 00000020:00080000:3.0:1783947719.604915:0:21074:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e7bc5514d40) has no exports 00010000:00010000:0.0:1783947719.605749:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947719.605760:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.605969:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947719.605973:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606097:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947719.606104:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947719.606110:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947719.606113:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1783947719.606116:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1783947719.606141:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:0.0:1783947719.606146:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606153:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606169:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947719.606172:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606178:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947719.606181:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606187:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947719.606573:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947719.606579:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783947719.606582:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783947719.606585:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:3.0:1783947719.606587:0:21074:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bc63fb420 - data ffff9e7bd1ffe870/ffff9e7bf7ad2800 00010000:00010000:0.0:1783947719.606593:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:0.0:1783947719.606599:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606605:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947719.606618:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947719.606621:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947719.606624:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783947719.606727:0:21074:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac7288780 - data ffff9e7ac5c1b1b0/ffff9e7bf7a0dc00 00010000:00010000:2.0:1783947719.607034:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1783947719.616494:0:21074:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783947719.621762:0:21074:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555014a9 00000020:00000080:2.0:1783947719.621775:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7be7b49800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783947719.621796:0:21074:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc7e0a000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783947719.621800:0:21074:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc7e0a000 2 00000020:01000004:2.0:1783947719.621803:0:21074:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7bc7e0a000 from lustre-OST0000 00000020:00000080:2.0:1783947719.621829:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947719.621838:0:21074:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1783947719.621864:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b49800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783947719.621876:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4e800/lustre-OST0000_UUID 00000020:00000080:2.0:1783947719.621885:0:21074:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783947719.621891:0:21074:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783947719.621971:0:21074:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783947719.621976:0:21074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783947719.621980:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947719.621985:0:21074:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783947719.621992:0:21074:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e7be7a24000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947719.621998:0:21074:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9e7c01b899c0) has exports, disconnecting them 00000020:00080000:2.0:1783947719.622003:0:21074:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e7be7a24000), last request at 1783947638 00000020:00000080:2.0:1783947719.622007:0:21074:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555014d3 00000020:00080000:2.0:1783947719.622016:0:21074:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7a24000): rc 0 00000020:00000080:2.0:1783947719.622021:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7be7a24000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783947719.622193:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a24000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783947719.627203:0:21074:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783947719.627212:0:21074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947719.627217:0:21074:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783947719.627225:0:21074:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947719.627256:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7a22800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783947719.627423:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947719.627433:0:21074:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783947719.627437:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783947719.627441:0:21074:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783947719.627447:0:21074:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783947719.627552:0:21074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783947719.627556:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947719.627561:0:21074:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947719.627568:0:21074:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e7be7a22000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947719.627574:0:21074:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9e7c01b8b380) has exports, disconnecting them 00000020:00080000:0.0:1783947719.627578:0:21074:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e7be7a22000), last request at 1783947638 00000020:00000080:0.0:1783947719.627582:0:21074:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555014e8 00000020:00080000:0.0:1783947719.627595:0:21074:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7a22000): rc 0 00000020:00000080:0.0:1783947719.627600:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7be7a22000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783947719.627632:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a22000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783947719.630776:0:21074:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783947719.630784:0:21074:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783947719.630788:0:21074:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783947719.630795:0:21074:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783947719.631083:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947719.631093:0:21074:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783947719.631105:0:21074:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc7e0a000 1 00000020:00000080:1.0:1783947719.631112:0:21074:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501486 00000020:00000080:1.0:1783947719.631120:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7bd159c000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783947719.631126:0:21074:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783947719.631131:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947719.631146:0:21074:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783947719.631149:0:21074:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9e7bf3fb0000) has no exports 00000020:00000080:1.0:1783947719.638281:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7a23800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783947719.638296:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7be7a23000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783947719.638299:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a23000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783947719.638312:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783947719.638381:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd159c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783947719.705547:0:21074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947719.705562:0:21074:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783947719.705569:0:21074:0:(genops.c:906:class_export_put()) final put ffff9e7bc7e0f000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783947719.705574:0:21074:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc7e0f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783947719.705602:0:21074:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783947719.705929:0:21074:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7bc7e0c000 00000020:02000400:1.0:1783947719.706294:0:21074:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1783947720.500840:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947720.948831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947720.948842:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947720.948845:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947720.948848:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783947720.949120:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236192896:0@lo:400:kworker.0 00000400:00000100:1.0:1783947720.949178:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236192896 offset 0 length 224: 4 00010000:00010000:0.0:1783947721.523532:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947721.651970:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947706/real 1783947706] req@ffff9e7be3fb1c00 x1870604236192000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1783947721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947721.652000:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7be3fb1c00 x1870604236192000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1783947721 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947721.652017:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947721.652035:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947721.652046:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236192000:0@lo:38:kworker.0 00000100:00080000:3.0:1783947721.652074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783947721.652079:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947721.652081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783947721.652084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783947721.652086:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947721.652091:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 591 00000100:00080000:3.0:1783947721.652096:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783947721.652103:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947721.652132:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9350e00 x1870604236193024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947721.652164:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236193024:0@lo:38:kworker.0 00000400:00000100:3.0:1783947721.652206:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236193024 offset 0 length 520: 4 00010000:00010000:2.0:1783947722.547757:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1783947722.806151:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947706/real 1783947706] req@ffff9e7be3fb1180 x1870604236192128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.830976:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e7be3fb1180 x1870604236192128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947722.830995:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a21000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783947722.830999:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783947722.844730:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1783947722.844803:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947722.844809:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947722.844834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947722.844838:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947722.844841:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947722.844844:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783947722.845340:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a21000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947722.845353:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1783947722.845366:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e7be7a21000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947722.845425:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a15880 x1870604236193152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947722.845538:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236193152:0@lo:38:kworker.0 00000400:00000100:0.0:1783947722.845623:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236193152 offset 0 length 520: 4 00000100:00100000:0.0:1783947722.845727:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236192128:0@lo:400:kworker.0 00000020:01000004:2.0:1783947722.958992:0:21277:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783947722.975072:0:21277:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783947722.975190:0:21277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.975210:0:21277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.975219:0:21277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.975227:0:21277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.975313:0:21277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783947722.975337:0:21277:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783947722.975378:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947722.975394:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bd9350e00 x1870604236193024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.975412:0:21277:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783947722.975487:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947722.975492:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1783947722.975497:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236193024:0@lo:38:kworker.0 00000100:00080000:0.0:1783947722.975532:0:21277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947722.975539:0:21277:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783947722.975544:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947722.975546:0:21277:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783947722.975550:0:21277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783947722.976373:0:20673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947722.976386:0:20673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.976396:0:20673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55a00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947722.976400:0:20673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.976412:0:20673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947722.976419:0:20673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947722.976426:0:20673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947722.976439:0:20673:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783947722.976442:0:20673:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783947722.976484:0:20673:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:2.0:1783947722.976489:0:20673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.976497:0:20673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.976513:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947722.976515:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947722.976517:0:20673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947722.977049:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783947722.977061:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bd9352300 x1870604236192384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947726 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977128:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7a14a80 x1870604236192512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977149:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf3487b80 x1870604236192768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947731 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977161:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7a16680 x1870604236192896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977169:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7a15880 x1870604236193152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977182:0:21277:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783947722.977213:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a21000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947722.977217:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1783947722.977230:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236193152:0@lo:38:kworker.0 00000100:00080000:0.0:1783947722.977271:0:21277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783947722.977277:0:21277:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a21000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783947722.977283:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783947722.977287:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bd9352300 x1870604236192384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947726 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947722.977358:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236192512:0@lo:400:kworker.0 00000100:00100000:0.0:1783947722.977922:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7a14a80 x1870604236192512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947727 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977933:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf3487b80 x1870604236192768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947731 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977941:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7a16680 x1870604236192896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947736 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947722.977949:0:21277:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783947722.977982:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236192384:0@lo:400:kworker.0 00000100:00100000:3.0:1783947722.978578:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236192896:0@lo:400:kworker.0 00000100:00100000:0.0:1783947722.980581:0:21277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:3.0:1783947722.980862:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236192768:0@lo:400:kworker.0 00010000:00010000:0.0:1783947722.984073:0:21277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984110:0:21277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984119:0:21277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984127:0:21277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984159:0:21277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947722.984168:0:21277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984194:0:21277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984200:0:21277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984206:0:21277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947722.984226:0:21277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783947722.984231:0:21277:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1783947722.984332:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947722.984342:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.984351:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947722.984354:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.984365:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947722.984373:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947722.984378:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947722.984381:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1783947722.984384:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1783947722.984411:0:17075:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00000020:01000004:0.0:1783947722.984560:0:21277:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:2.0:1783947722.984565:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1783947722.984566:0:21277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1783947722.984573:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783947722.984573:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947722.984580:0:21277:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783947722.984585:0:21277:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9e7ac7220000) has no exports 00010000:00010000:2.0:1783947722.984588:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947722.984592:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.984597:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947722.984599:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.984606:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947722.984612:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783947722.984614:0:21277:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9e7ac7220000) has no exports 10000000:01000000:2.0:1783947722.984617:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783947722.984619:0:17075:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783947722.984621:0:17075:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783947722.984630:0:17075:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:2.0:1783947722.984633:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947722.984640:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947722.984769:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947722.984806:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947722.984808:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947722.984810:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783947722.987620:0:21277:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bc63fbde0 - data ffff9e7bd1ffe1b0/ffff9e7bf7ad1000 00000020:01000000:0.0:1783947722.987834:0:21277:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac73e23c0 - data ffff9e7bead97000/ffff9e7bf7a60000 00100000:10000000:0.0:1783947722.999159:0:21277:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783947723.010546:0:21277:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501607 00000020:00000080:1.0:1783947723.010561:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7ac7c00000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783947723.010580:0:21277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7ac7c05800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783947723.010583:0:21277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7c05800 2 00000020:01000004:1.0:1783947723.010587:0:21277:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7ac7c05800 from lustre-OST0001 00000020:00000080:1.0:1783947723.010618:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947723.010627:0:21277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783947723.010630:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7ac179e800/lustre-OST0001_UUID 00000020:00000080:1.0:1783947723.010633:0:21277:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac179e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783947723.010640:0:21277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783947723.010729:0:21277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS 00010000:00010000:1.0:1783947723.010744:0:21277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947723.010763:0:21277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947723.010770:0:21277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783947723.010772:0:21277:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783947723.010776:0:21277:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783947723.010790:0:21277:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:1.0:1783947723.010794:0:21277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947723.010809:0:21277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947723.010815:0:21277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947723.010820:0:21277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947723.010822:0:21277:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783947723.010824:0:21277:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783947723.010832:0:21277:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc48d4800 00010000:00010000:1.0:1783947723.010835:0:21277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947723.010850:0:21277:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783947723.010853:0:21277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783947723.010855:0:21277:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783947723.010856:0:21277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783947723.010860:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783947723.010871:0:21277:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf3485880 x1870604236192640/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783947730 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783947723.010899:0:21277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783947723.010902:0:21277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:2.0:1783947723.010985:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7c00000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1783947723.014542:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3636:1870604236192640:0@lo:250:kworker.0 10000000:01000000:1.0:1783947723.014627:0:21277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783947723.014640:0:21277:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550122c 00000020:00000080:1.0:1783947723.014648:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7bc48d2000/c5bf4e70-0b4f-4c54-b791-4147365ffdfe 00000020:01000000:1.0:1783947723.014667:0:21277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.103@tcp (flags='') 00000020:00000080:1.0:1783947723.014673:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947723.014681:0:21277:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947723.014686:0:21277:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9e7ac7798000) has no exports 00000020:00000080:2.0:1783947723.014729:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc48d2000/c5bf4e70-0b4f-4c54-b791-4147365ffdfe for MGC192.168.204.103@tcp 10000000:01000000:3.0:1783947723.014997:0:17085:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783947723.015231:0:21277:0:(obd_class.h:673:obd_cleanup_client_import()) MGC192.168.204.103@tcp: client import never connected 00000100:00080000:1.0:1783947723.015237:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783947723.015244:0:21277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783947723.015249:0:21277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783947723.015275:0:21277:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783947723.015325:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc48d4800 for MGC192.168.204.103@tcp 00000020:00000080:1.0:1783947723.015350:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947723.015363:0:21277:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.103@tcp (uuid c5bf4e70-0b4f-4c54-b791-4147365ffdfe) 00000020:00000080:1.0:1783947723.015368:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7bc48d7800/c5bf4e70-0b4f-4c54-b791-4147365ffdfe 00000020:00000080:1.0:1783947723.015373:0:21277:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc48d7800/c5bf4e70-0b4f-4c54-b791-4147365ffdfe for MGC192.168.204.103@tcp 00000020:01000000:1.0:1783947723.015380:0:21277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.103@tcp (c5bf4e70-0b4f-4c54-b791-4147365ffdfe) 00000020:01000000:1.0:1783947723.016252:0:21277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783947723.016261:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947723.016270:0:21277:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783947723.016279:0:21277:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e7ac5824800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783947723.016286:0:21277:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9e7bc47b8000) has exports, disconnecting them 00000020:00080000:1.0:1783947723.016292:0:21277:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e7ac5824800), last request at 1783947655 00000020:00000080:1.0:1783947723.016298:0:21277:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501631 00000020:00080000:1.0:1783947723.016320:0:21277:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac5824800): rc 0 00000020:00000080:1.0:1783947723.016327:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7ac5824800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783947723.021008:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5824800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783947723.029567:0:21277:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783947723.029583:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947723.029589:0:21277:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783947723.029599:0:21277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783947723.029842:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947723.029855:0:21277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783947723.029864:0:21277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783947723.029875:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947723.029881:0:21277:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783947723.029891:0:21277:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e7bc4734000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947723.029899:0:21277:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9e7ac7224d40) has exports, disconnecting them 00000020:00080000:2.0:1783947723.029904:0:21277:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e7bc4734000), last request at 1783947655 00000020:00000080:2.0:1783947723.029909:0:21277:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55501646 00000020:00000080:3.0:1783947723.030006:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5827000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783947723.030017:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7ac179a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783947723.030023:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac179a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783947723.030041:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00080000:2.0:1783947723.030222:0:21277:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bc4734000): rc 0 00000020:00000080:2.0:1783947723.030230:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7bc4734000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1783947723.030301:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc4734000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1783947723.040600:0:21277:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783947723.040614:0:21277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783947723.040640:0:21277:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783947723.040650:0:21277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947723.040712:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7a21000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1783947723.040790:0:20673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783947723.040952:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1783947723.041038:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1783947723.041154:0:17070:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e7ac7e53000:17070] 0 exiting: rc = 1 00000100:00100000:3.0:1783947723.041244:0:17071:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e7bf6865000:17071] 1 exiting: rc = 0 00000100:00100000:3.0:1783947723.041335:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.041717:0:17072:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e7ac7e52000:17072] 0 exiting: rc = 1 00000100:00100000:3.0:1783947723.041816:0:18240:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e7bd57a4800:18240] 3 exiting: rc = 0 00000100:00100000:3.0:1783947723.041903:0:17074:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e7ac7e53600:17074] 2 exiting: rc = 0 00000100:00100000:1.0:1783947723.042424:0:17073:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e7ac7e52c00:17073] 1 exiting: rc = 0 00000100:00100000:3.0:1783947723.045905:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045921:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045929:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045935:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045942:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045951:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045958:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045964:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045969:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045975:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045981:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045986:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.045994:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046000:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046006:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046012:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046017:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046023:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046029:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046035:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046041:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046075:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046080:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046085:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046093:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046098:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046105:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046111:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046117:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046122:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046128:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046134:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046141:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046146:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046152:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046161:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046167:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046174:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046180:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046186:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046191:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046197:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046203:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046209:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046215:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046221:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046227:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046234:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046241:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046247:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046511:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046521:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046527:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046533:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046539:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046545:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046562:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046567:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046573:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046579:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046584:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046594:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046601:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.046608:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783947723.052753:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947723.052774:0:21277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1783947723.052783:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7ac5bc2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1783947723.052791:0:21277:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5bc2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1783947723.052799:0:21277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1783947723.052867:0:21277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7c05800 1 00000020:00000080:3.0:1783947723.052875:0:21277:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555015eb 00000020:00000080:3.0:1783947723.052882:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7ac1799800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783947723.052902:0:21277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783947723.052918:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac1799800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783947723.052933:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947723.052939:0:21277:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783947723.052944:0:21277:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9e7bc5513380) has no exports 00000020:00000080:2.0:1783947723.117611:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947723.117633:0:21277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783947723.117641:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7ac7c03800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783947723.117659:0:21277:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7c03800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783947723.117674:0:21277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783947723.118738:0:21277:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7ac7c02800 00000020:01000000:2.0:1783947723.118776:0:21277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783947723.118782:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947723.118788:0:21277:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783947723.118794:0:21277:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9e7bc47bcd40) has no exports 00000020:00000080:2.0:1783947723.118822:0:21277:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947723.118831:0:21277:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783947723.118836:0:21277:0:(genops.c:906:class_export_put()) final put ffff9e7bd159a800/OSS_uuid 00000020:00000080:2.0:1783947723.118839:0:21277:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd159a800/OSS_uuid for OSS 00000020:01000000:2.0:1783947723.118844:0:21277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1783947723.119131:0:17083:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783947723.119361:0:20439:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9e7be7b17200:20439] 4 exiting: rc = 0 00000100:00100000:2.0:1783947723.119529:0:18593:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e7be7871800:18593] 0 exiting: rc = 1 00000100:00100000:2.0:1783947723.119594:0:18594:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e7c01d58200:18594] 1 exiting: rc = 0 00000100:00100000:2.0:1783947723.119660:0:18595:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e7c01d59e00:18595] 2 exiting: rc = 0 00000100:00100000:3.0:1783947723.125786:0:19073:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e7ac8588000:19073] 3 exiting: rc = 0 00000100:00100000:2.0:1783947723.126906:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126919:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126926:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126943:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126949:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126955:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126962:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126967:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126973:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126978:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126983:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126989:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.126995:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127117:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127126:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127132:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127138:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127143:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127149:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127174:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127180:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127186:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127193:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127199:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127205:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127210:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127217:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127223:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127239:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127246:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127261:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127267:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127274:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127280:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127286:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127293:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127300:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127306:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127313:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127318:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127325:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127332:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127337:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127344:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127350:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127355:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127361:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127368:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127375:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127381:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127394:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127402:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127407:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127414:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127435:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127441:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127570:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127577:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127584:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127591:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127597:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127602:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127608:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.127615:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.129768:0:18596:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e7c01d58400:18596] 0 exiting: rc = 1 00000100:00100000:2.0:1783947723.130093:0:18597:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e7c01d58800:18597] 1 exiting: rc = 0 00000100:00100000:3.0:1783947723.130234:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130244:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130249:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130317:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130323:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130330:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130336:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130342:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130348:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130353:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130358:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130382:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130388:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130395:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130401:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130407:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130412:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130418:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130424:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130430:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130435:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130441:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130657:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130665:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130672:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130679:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130685:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130690:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130695:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130700:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130705:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130711:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130718:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130726:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130736:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130744:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130749:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130756:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130763:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130771:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130778:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130784:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130790:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130797:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130802:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130808:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130822:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130828:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130834:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130839:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130844:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130851:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130857:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130863:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130869:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130874:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130880:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130886:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130896:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.130926:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.131073:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.131080:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.131087:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.131093:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.134891:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e7bf6850c00:18599] 1 exiting: rc = 0 00000100:00100000:1.0:1783947723.135413:0:18600:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e7bf6851600:18600] 2 exiting: rc = 0 00000100:00100000:3.0:1783947723.135612:0:18598:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e7ac5ae7a00:18598] 0 exiting: rc = 1 00000100:00100000:2.0:1783947723.136229:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136243:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136257:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136268:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136289:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136301:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136311:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136321:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136335:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136344:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136735:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136791:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136805:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136816:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136829:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136839:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136851:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136861:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136871:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136889:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136899:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136910:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136921:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136948:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136954:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136961:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136967:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136974:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136980:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136986:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136992:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.136998:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137010:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137016:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137023:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137042:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137050:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137057:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137063:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137083:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137093:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137103:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137113:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137122:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137134:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137146:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137157:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137169:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137179:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137190:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137202:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137213:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137224:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137236:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137425:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137438:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137543:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137561:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137583:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137591:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137804:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137834:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137858:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947723.137882:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947723.153058:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e7ac7142800:18602] 1 exiting: rc = 0 00000100:00100000:1.0:1783947723.153362:0:18601:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e7bf6850400:18601] 0 exiting: rc = 1 00000100:00100000:0.0:1783947723.156694:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156707:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156712:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156719:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156724:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156733:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156738:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156743:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156826:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156832:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156862:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156868:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156875:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156881:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156887:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156893:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156900:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156906:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156912:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156920:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156927:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156933:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156939:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.156945:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157053:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157062:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157069:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157075:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157081:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157087:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157093:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157098:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157104:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157110:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157115:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157130:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157138:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157144:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157150:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157156:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157162:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157167:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157173:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157178:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157183:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157197:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157226:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157234:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157239:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157245:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157250:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157256:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157261:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157266:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157271:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157276:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157283:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157288:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157293:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157299:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157304:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157310:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157316:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947723.157322:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.164562:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e7ac8485c00:18603] 0 exiting: rc = 1 00000100:00100000:2.0:1783947723.165018:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e7ac8485800:18604] 1 exiting: rc = 0 00000100:00100000:1.0:1783947723.165329:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165339:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165346:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165352:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165360:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165368:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165376:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165382:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165412:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165420:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165427:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165434:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165485:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165595:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165605:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165613:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165622:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165629:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165638:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165645:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165670:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165681:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165689:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165696:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165703:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165710:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165717:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165724:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165768:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165775:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165782:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165789:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165810:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165819:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165825:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165831:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165839:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165847:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165853:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165861:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165867:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165875:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165882:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165889:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165911:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165919:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165925:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165933:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.165940:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166062:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166073:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166080:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166089:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166096:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166104:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166113:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166137:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166148:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166156:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166164:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166183:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166201:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166209:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947723.166236:0:21277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1783947723.189757:0:21277:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783947743.163580:0:22041:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783947753.149756:0:22640:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783947753.149762:0:22640:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783947753.149764:0:22640:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783947753.149894:0:22640:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7bf7a56000 00000020:01000004:2.0:1783947753.149913:0:22640:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783947753.149921:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783947753.149936:0:22640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e7ac72219c0) 00000020:00000080:2.0:1783947753.149952:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783947753.281557:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783947753.284132:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.292209:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783947753.294630:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.298625:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.301208:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.302271:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.302608:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.303075:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.304179:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.305112:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.306958:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.309200:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.310129:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.310956:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.312091:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.314554:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.315085:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.316233:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.319767:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.320253:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.320764:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783947753.321086:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783947753.321329:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783947753.322201:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.322650:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.322923:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.323271:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783947753.323637:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.323883:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.324070:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783947753.325091:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.325838:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783947753.326263:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783947753.326680:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783947753.330199:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783947753.331428:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783947753.332118:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783947753.332757:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783947753.332979:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783947753.333191:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783947753.334693:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783947753.335699:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783947753.337857:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783947753.338188:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783947753.338638:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783947753.338860:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783947753.341532:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1783947753.345579:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783947753.345982:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783947753.346566:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783947753.347623:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783947753.347958:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1783947753.348637:0:22640:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783947753.348861:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783947753.348882:0:22640:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783947753.348894:0:22640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501b32 00000020:01000004:3.0:1783947753.348901:0:22640:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783947753.348906:0:22640:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783947753.348912:0:22640:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bf7a56000 from MGS 00000020:01000004:3.0:1783947753.348915:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783947753.348925:0:22640:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e7be3f34d40) 00000020:00000080:3.0:1783947753.348934:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783947753.348994:0:22640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bf7a56000 from MGS, refs=2 00080000:01000000:3.0:1783947753.348998:0:22640:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947753.349003:0:22640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501b40 00000100:00100000:3.0:1783947753.349115:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783947753.349237:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783947753.349242:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783947753.350584:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783947753.350593:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783947753.351248:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947753.353580:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783947753.353604:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783947753.354414:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783947753.354423:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783947753.354958:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783947753.354965:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783947753.358942:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.358954:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.358956:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.360436:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.360443:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.360445:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947753.361049:0:22640:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783947753.364709:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783947753.367117:0:22640:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783947753.375833:0:22652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783947753.375937:0:22640:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783947753.376009:0:22640:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783947753.376668:0:22640:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783947753.376989:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947753.377144:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783947753.377150:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783947753.378023:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783947753.378032:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783947753.378619:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783947753.378627:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783947753.379236:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783947753.379258:0:22640:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.103@tcp' 00000020:01000004:1.0:1783947753.379260:0:22640:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783947753.379289:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.103@tcp (typ=mgc) 00000020:00000080:1.0:1783947753.379303:0:22640:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.103@tcp (ffff9e7bc47bb380) 00000020:00000080:1.0:1783947753.379319:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783947753.379419:0:22640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7beee92000@MGC192.168.204.103@tcp: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947753.379601:0:22640:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.103@tcp-0 is initialized 00000040:01000000:1.0:1783947753.379607:0:22640:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783947753.380324:0:22657:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783947753.380826:0:22658:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783947753.380902:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.103@tcp (uuid 39423f5f-9729-4dc0-9c01-dc528f57ea81) 00000020:00000080:1.0:1783947753.380923:0:22640:0:(genops.c:1406:class_connect()) connect: client 39423f5f-9729-4dc0-9c01-dc528f57ea81, cookie 0xe6fd1fdb55501b4e 00000100:00080000:1.0:1783947753.380934:0:22640:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947753.380940:0:22640:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7beee92000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947753.380974:0:22640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7be3fb1880 x1870604236193280/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947753.381042:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39423f5f-9729-4dc0-9c01-dc528f57ea81:3636:1870604236193280:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783947753.381115:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783947753.381188:0:22640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 39423f5f-9729-4dc0-9c01-dc528f57ea81->MGS 00000020:01000004:1.0:1783947753.381213:0:22640:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783947753.381219:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783947753.381233:0:22640:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e7bc47b99c0) 00000020:00000080:1.0:1783947753.381246:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783947753.384947:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236193280 00000100:00100000:3.0:1783947753.384966:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236193280 00000100:00100000:3.0:1783947753.385013:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947753.385022:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1870604236193280:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783947753.385060:0:22654:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 39423f5f-9729-4dc0-9c01-dc528f57ea81@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:3.0:1783947753.385096:0:22654:0:(genops.c:1406:class_connect()) connect: client 39423f5f-9729-4dc0-9c01-dc528f57ea81, cookie 0xe6fd1fdb55501b5c 00000100:00080000:3.0:1783947753.385230:0:22654:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1482000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947753.385326:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+5:3636:x1870604236193280:12345-0@lo:250:mount.lustre.0 Request processed in 303us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.385334:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947753.385429:0:3636:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783947753.385439:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.103@tcp: connect to target with instance 0 00000100:00080000:2.0:1783947753.385447:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783947753.385452:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783947753.385468:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7beee92000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783947753.385471:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783947753.385481:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783947753.385486:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39423f5f-9729-4dc0-9c01-dc528f57ea81:3636:1870604236193280:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783947753.394794:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947753.397604:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947753.397616:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783947753.398896:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783947753.398907:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783947753.399206:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783947753.399213:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783947753.399948:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947753.400127:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783947753.400132:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783947753.401809:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783947753.401820:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783947753.455613:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947753.456019:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783947753.456027:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783947753.458051:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783947753.458131:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783947753.459232:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947753.459404:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783947753.459410:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783947753.460197:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783947753.460205:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783947753.460875:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947753.461017:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783947753.461022:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783947753.461543:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783947753.461550:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783947753.462168:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947753.462641:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783947753.462646:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783947753.463325:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783947753.463333:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783947753.479246:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947753.479880:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947753.479889:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783947753.481308:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947753.481318:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783947753.482328:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947753.482339:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783947753.483368:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783947753.483396:0:22640:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783947753.483403:0:22640:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783947753.483543:0:22640:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947753.483577:0:22640:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783947753.483582:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947753.483584:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947753.483585:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947753.483586:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947753.483588:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947753.483589:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947753.483590:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947753.483592:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947753.483594:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947753.483596:0:22640:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947753.483598:0:22640:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783947753.483601:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947753.483602:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947753.483604:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947753.483605:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947753.483606:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947753.483607:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947753.483613:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947753.483614:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947753.483615:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947753.483616:0:22640:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947753.483653:0:22640:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783947753.483675:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783947753.483829:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.483932:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7a506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.484133:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236193408 00000100:00100000:3.0:1783947753.484142:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236193408 00000100:00100000:3.0:1783947753.484221:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947753.484232:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+5:22640:x1870604236193408:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783947753.484281:0:22656:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783947753.484284:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783947753.484287:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783947753.484640:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783947753.485178:0:22656:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1783947753.486628:0:22678:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783947753.486636:0:22678:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783947753.486639:0:22678:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783947753.486642:0:22678:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783947753.489089:0:22678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783947753.489415:0:22656:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783947753.490174:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783947753.499216:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+5:22640:x1870604236193408:12345-0@lo:253:mount.lustre.0 Request processed in 14976us (15378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.499231:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947753.499412:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947753.499431:0:22640:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783947753.499434:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947753.499436:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947753.499438:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947753.499439:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947753.499440:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947753.499441:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947753.499442:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947753.499444:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947753.499446:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947753.499447:0:22640:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947753.499548:0:22640:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bf7a56000 from lustre-MDT0000 10000000:01000000:1.0:1783947753.499581:0:22640:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783947753.499584:0:22640:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783947753.499588:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e7bc47bb380 10000000:01000000:1.0:1783947753.499595:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947753.499604:0:22640:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7bc47bb380 from 1 10000000:01000000:1.0:1783947753.499607:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947753.499645:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.499656:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.499666:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947753.499699:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947753.500028:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.500121:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7a50840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.500440:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236193536 00000100:00100000:3.0:1783947753.500448:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236193536 00000100:00100000:3.0:1783947753.500552:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947753.500570:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+5:22640:x1870604236193536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947753.500587:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947753.500603:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb55501b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501b63 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.500628:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb55501b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501b63 expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.500640:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb55501b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501b63 expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.500649:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846be00, rc 0) 00000100:00100000:3.0:1783947753.500704:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+6:22640:x1870604236193536:12345-0@lo:101:mount.lustre.0 Request processed in 136us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.500725:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947753.500800:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947753.500816:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.500824:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947753.500919:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947753.500949:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947753.502591:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc4c2f300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947753.503704:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236193664 00000100:00100000:1.0:1783947753.504181:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236193664 00000100:00100000:1.0:1783947753.504241:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947753.504251:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+6:22640:x1870604236193664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947753.504405:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+6:22640:x1870604236193664:12345-0@lo:501:mount.lustre.0 Request processed in 155us (3453us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947753.504415:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947753.504629:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193664:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783947753.504687:0:22640:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783947753.504720:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.504730:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947753.504739:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bf7a56000 10000000:01000000:0.0:1783947753.504745:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947753.504749:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e7bf7a56000 10000000:01000000:0.0:1783947753.504752:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783947753.504756:0:22640:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e7bf7a56000 from 1 10000000:01000000:0.0:1783947753.504760:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783947753.504794:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.504803:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.504812:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947753.504833:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947753.505196:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947753.505232:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc4c2f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947753.507345:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236193792 00000100:00100000:2.0:1783947753.507361:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236193792 00000100:00100000:2.0:1783947753.507430:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947753.507440:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+6:22640:x1870604236193792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947753.507475:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947753.507498:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb55501b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501b71 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.507526:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb55501b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501b71 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.507538:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb55501b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501b71 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.507548:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fc00, rc 0) 00000100:00100000:2.0:1783947753.507622:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+7:22640:x1870604236193792:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.507628:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947753.507949:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947753.507968:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b78 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.507997:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501b78 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947753.508028:0:22640:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783947753.508243:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b78 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.508252:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97a00/0xe6fd1fdb55501b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b78 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947753.508261:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783947753.508266:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947753.508273:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e7bf7a56000 10000000:01000000:0.0:1783947753.508277:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783947753.508281:0:22640:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783947753.508289:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783947753.508320:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.508327:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.508336:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947753.508504:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947753.508681:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.508814:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc4c2f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947753.508852:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236193920 00000100:00100000:0.0:1783947753.508857:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236193920 00000100:00100000:0.0:1783947753.508911:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947753.508918:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+7:22640:x1870604236193920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947753.508930:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947753.508941:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96c00/0xe6fd1fdb55501b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501b7f expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.508961:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96c00/0xe6fd1fdb55501b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501b7f expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.508970:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96c00/0xe6fd1fdb55501b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501b7f expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.508979:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96c00, rc 0) 00000100:00100000:0.0:1783947753.509062:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+8:22640:x1870604236193920:12345-0@lo:101:mount.lustre.0 Request processed in 143us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947753.509068:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947753.509424:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236193920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947753.509437:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b86 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.509445:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501b86 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947753.509533:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236194048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947753.509619:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.509701:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7a503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.509778:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236194048 00000100:00100000:3.0:1783947753.509783:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236194048 00000100:00100000:3.0:1783947753.509857:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947753.509875:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+8:22640:x1870604236194048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947753.510024:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22640:x1870604236194048:12345-0@lo:501:mount.lustre.0 Request processed in 161us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.510032:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947753.510131:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236194048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947753.510178:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236194176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947753.510220:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.510289:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7a503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.510335:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236194176 00000100:00100000:3.0:1783947753.510339:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236194176 00000100:00100000:3.0:1783947753.510365:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947753.510372:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22640:x1870604236194176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947753.511808:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22640:x1870604236194176:12345-0@lo:503:mount.lustre.0 Request processed in 1430us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.511829:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947753.521664:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236194176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947753.525918:0:22679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22679:1870604236194304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947753.526031:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.526177:0:22679:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7a500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947753.526223:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236194304 00000100:00100000:2.0:1783947753.526229:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236194304 00000100:00100000:2.0:1783947753.526329:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947753.526338:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22679:x1870604236194304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947753.527391:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22679:x1870604236194304:12345-0@lo:502:llog_process_th.0 Request processed in 1049us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.527402:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947753.527724:0:22679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22679:1870604236194304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947753.527758:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947753.527770:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947753.527772:0:22679:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783947753.527777:0:22679:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783947753.527780:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947753.527794:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e7bc47bcd40) 00000020:00000080:1.0:1783947753.527809:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783947753.527814:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783947753.527913:0:22679:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783947753.527920:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501b94 00000020:00000080:1.0:1783947753.528235:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783947753.528239:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947753.528243:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947753.528244:0:22679:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783947753.528247:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947753.528250:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947753.528251:0:22679:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783947753.528254:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947753.528262:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e7bc47b8000) 00000020:00000080:1.0:1783947753.528272:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783947753.528276:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783947753.528278:0:22679:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783947753.528287:0:22679:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783947753.528293:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783947753.528408:0:22679:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bf7a56000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783947753.528424:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e7be7b43380) 00000020:00000080:1.0:1783947753.528433:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783947753.528627:0:22679:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783947753.528633:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501ba9 00000020:00000080:1.0:1783947753.529171:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783947753.529179:0:22679:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783947753.529184:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe6fd1fdb55501bb0 00080000:01000000:1.0:1783947753.529190:0:22679:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783947753.529194:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501bb7 00010000:00010000:2.0:1783947753.595735:0:22679:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783947753.596421:0:22679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1783947753.596806:0:22679:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783947753.597322:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e7ac7223380) 00000020:00000080:2.0:1783947753.597341:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783947753.597442:0:22679:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783947753.597448:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501bc5 00000020:00000080:3.0:1783947753.599013:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783947753.602108:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe6fd1fdb55501bcc 00000020:00000080:3.0:1783947753.602608:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783947753.602621:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947753.602627:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947753.602629:0:22679:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783947753.602632:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783947753.602636:0:22679:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783947753.602637:0:22679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947753.602639:0:22679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947753.602640:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783947753.602642:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947753.602644:0:22679:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783947753.602646:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947753.602651:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947753.602653:0:22679:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783947753.602657:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783947753.602694:0:22679:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783947753.602705:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947753.602708:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947753.602709:0:22679:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783947753.602711:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947753.602714:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947753.602715:0:22679:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783947753.602718:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783947753.602723:0:22679:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:3.0:1783947753.602750:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947753.602764:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e7be3f319c0) 00000020:00000080:3.0:1783947753.602776:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783947753.602780:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783947753.602839:0:22679:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783947753.602846:0:22679:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783947753.602851:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501bda 00010000:00080000:3.0:1783947753.602899:0:22679:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc48d6800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947753.604694:0:22679:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1783947753.606117:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947753.606131:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783947753.606166:0:22679:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783947753.606186:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501be1 00000100:00080000:2.0:1783947753.606196:0:22679:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947753.606202:0:22679:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7bc48d6800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947753.606240:0:22679:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3484e00 x1870604236194432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947753.606268:0:22679:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783947753.606539:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236194432:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783947753.606626:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783947753.606756:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.606760:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.606762:0:22679:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783947753.606764:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783947753.606767:0:22679:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1783947753.606769:0:22679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947753.606770:0:22679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947753.606771:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783947753.606780:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.606781:0:22679:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783947753.606786:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947753.606790:0:22679:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783947753.606793:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.606794:0:22679:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783947753.606797:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783947753.606800:0:22679:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:2.0:1783947753.606823:0:22679:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783947753.606826:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947753.606839:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e7ac7224d40) 00000020:00000080:2.0:1783947753.606851:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783947753.606856:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783947753.606924:0:22679:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783947753.606930:0:22679:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783947753.606935:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501bef 00010000:00080000:2.0:1783947753.606964:0:22679:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc48d2000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.103@tcp at head 00000100:00100000:1.0:1783947753.607168:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236194432 00000100:00100000:1.0:1783947753.607176:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236194432 00000100:00100000:1.0:1783947753.607209:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947753.607217:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236194432:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1783947753.607232:0:22666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1783947753.611103:0:22679:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783947753.615808:0:22679:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783947753.617437:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783947753.621674:0:22679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947753.621960:0:22679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1783947753.630265:0:22679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1783947753.632597:0:22685:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783947753.632607:0:22685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1783947753.634177:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236194432:12345-0@lo:38:llog_process_th.0 Request processed in 26952us (27543us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783947753.634191:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783947753.635535:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947753.635545:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947753.635550:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236194432:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1783947753.636024:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947753.636121:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783947753.636167:0:22679:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783947753.636187:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501bf6 00000100:00080000:2.0:1783947753.636196:0:22679:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947753.636201:0:22679:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bc48d2000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947753.636240:0:22679:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3484e00 x1870604236194560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947753.636283:0:22679:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783947753.636584:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.636589:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.636591:0:22679:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783947753.636594:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783947753.636597:0:22679:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1783947753.636598:0:22679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947753.636600:0:22679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947753.636601:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783947753.636604:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.636605:0:22679:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783947753.636608:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947753.636613:0:22679:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783947753.636616:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.636617:0:22679:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783947753.636620:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783947753.636624:0:22679:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:2.0:1783947753.636650:0:22679:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783947753.636653:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947753.636666:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e7ac7220000) 00000020:00000080:2.0:1783947753.636677:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1783947753.636683:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783947753.636745:0:22679:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783947753.636752:0:22679:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783947753.636759:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501c04 00010000:00080000:2.0:1783947753.636804:0:22679:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac5827000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1783947753.637021:0:22679:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783947753.637107:0:22679:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783947753.637123:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783947753.638549:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236194560:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783947753.638611:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236194560 offset 0 length 520: 4 00000040:00080000:2.0:1783947753.641258:0:22679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947753.642178:0:22679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1783947753.643012:0:22679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1783947753.644167:0:22687:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783947753.644174:0:22687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783947753.645169:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947753.645183:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783947753.645220:0:22679:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783947753.645240:0:22679:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501c0b 00000100:00080000:2.0:1783947753.645250:0:22679:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947753.645255:0:22679:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947753.645296:0:22679:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3485880 x1870604236194688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947753.645442:0:22679:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783947753.645556:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.645561:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.645563:0:22679:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783947753.645578:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947753.645582:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.645583:0:22679:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947753.645586:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947753.645588:0:22679:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947753.645590:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.645593:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.645594:0:22679:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783947753.645596:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947753.645598:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.645600:0:22679:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783947753.645604:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783947753.645641:0:22679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22679:1870604236194816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947753.645734:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.645773:0:22679:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.645910:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236194688:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783947753.645952:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236194688 offset 0 length 520: 4 00000100:00100000:0.0:1783947753.646528:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236194816 00000100:00100000:0.0:1783947753.646536:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236194816 00000100:00100000:0.0:1783947753.646589:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947753.646598:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22679:x1870604236194816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947753.646735:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22679:x1870604236194816:12345-0@lo:502:llog_process_th.0 Request processed in 138us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947753.646744:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947753.647253:0:22679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22679:1870604236194816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947753.647292:0:22679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.647306:0:22679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.647307:0:22679:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783947753.647312:0:22679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783947753.648018:0:22640:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783947753.648042:0:22640:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783947753.648102:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b86 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.648114:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb55501b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b86 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947753.648122:0:22640:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bf7a56000 from 1 10000000:01000000:3.0:1783947753.648125:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947753.648165:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.648179:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.648189:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947753.648212:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236194944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783947753.648270:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947753.648314:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947753.648434:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236194944 00000100:00100000:0.0:1783947753.648441:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236194944 00000100:00100000:0.0:1783947753.648510:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947753.648520:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+9:22640:x1870604236194944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947753.648539:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947753.648552:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c12 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.648575:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.648586:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.648595:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947753.648634:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+10:22640:x1870604236194944:12345-0@lo:101:mount.lustre.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947753.648641:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947753.648725:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236194944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947753.648739:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.648747:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947753.649291:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195072:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783947753.649329:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947753.649503:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947753.649677:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195072 00000100:00100000:1.0:1783947753.649682:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195072 00000100:00100000:1.0:1783947753.649719:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947753.649726:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+10:22640:x1870604236195072:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783947753.649744:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783947753.649749:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783947753.649811:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+10:22640:x1870604236195072:12345-0@lo:256:mount.lustre.0 Request processed in 86us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947753.649818:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947753.649917:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195072:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783947753.650588:0:22640:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947753.650608:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.650618:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947753.650681:0:22640:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bf7a56000 from 1 10000000:01000000:3.0:1783947753.650683:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947753.650711:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.650718:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.650727:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947753.650742:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783947753.650777:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947753.650813:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947753.650888:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195200 00000100:00100000:0.0:1783947753.650894:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195200 00000100:00100000:0.0:1783947753.650931:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947753.650941:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+10:22640:x1870604236195200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947753.650954:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947753.650970:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c20 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.650990:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.651000:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947753.651008:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96000, rc 0) 00000100:00100000:0.0:1783947753.651048:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22640:x1870604236195200:12345-0@lo:101:mount.lustre.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947753.651055:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947753.651136:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947753.651148:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.651157:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947753.651211:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947753.651239:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947753.651300:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947753.651732:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195328 00000100:00100000:0.0:1783947753.651738:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195328 00000100:00100000:0.0:1783947753.651809:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947753.651816:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22640:x1870604236195328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947753.651968:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22640:x1870604236195328:12345-0@lo:501:mount.lustre.0 Request processed in 152us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947753.651975:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947753.652055:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947753.652088:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947753.652127:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.652155:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9e540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947753.652209:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195456 00000100:00100000:1.0:1783947753.652213:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195456 00000100:00100000:2.0:1783947753.652294:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947753.652300:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22640:x1870604236195456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947753.652396:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22640:x1870604236195456:12345-0@lo:503:mount.lustre.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.652403:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947753.652444:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947753.652930:0:22689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22689:1870604236195584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947753.652967:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.652999:0:22689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947753.653048:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195584 00000100:00100000:0.0:1783947753.653053:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195584 00000100:00100000:0.0:1783947753.653089:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947753.653096:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22689:x1870604236195584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947753.653679:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22689:x1870604236195584:12345-0@lo:502:llog_process_th.0 Request processed in 581us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947753.653687:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947753.653901:0:22689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22689:1870604236195584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947753.653929:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947753.653939:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.653941:0:22689:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947753.653949:0:22689:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bf7a56000 00000020:00000080:2.0:1783947753.653952:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947753.653960:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.653963:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.653964:0:22689:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783947753.653967:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947753.653976:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.653977:0:22689:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783947753.653982:0:22689:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bf7a56000 00000020:00000080:2.0:1783947753.653984:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947753.654090:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.654095:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.654096:0:22689:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783947753.654098:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947753.654101:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.654102:0:22689:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947753.654106:0:22689:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bf7a56000 00000020:00000080:2.0:1783947753.654108:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947753.657529:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.657542:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.657544:0:22689:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947753.657549:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947753.657553:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.657555:0:22689:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783947753.657560:0:22689:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bf7a56000 00000020:00000080:2.0:1783947753.657562:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783947753.657650:0:22689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22689:1870604236195712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947753.657728:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.657781:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195712 00000100:00100000:2.0:1783947753.657788:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195712 00000100:00100000:2.0:1783947753.657838:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947753.657847:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22689:x1870604236195712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947753.657979:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22689:x1870604236195712:12345-0@lo:502:llog_process_th.0 Request processed in 133us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.657987:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947753.658042:0:22689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947753.658065:0:22689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22689:1870604236195712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947753.658094:0:22689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947753.658099:0:22689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947753.658101:0:22689:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783947753.658104:0:22689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783947753.660531:0:22640:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783947753.660567:0:22640:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947753.660588:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.660601:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947753.660657:0:22640:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783947753.660660:0:22640:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bf7a56000 10000000:01000000:2.0:1783947753.660664:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bf7a56000 10000000:01000000:2.0:1783947753.660669:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947753.660675:0:22640:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bf7a56000 from 1 10000000:01000000:2.0:1783947753.660678:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947753.660716:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.660726:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.660737:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947753.660762:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947753.660824:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.660881:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.661029:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195840 00000100:00100000:3.0:1783947753.661037:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195840 00000100:00100000:3.0:1783947753.661117:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947753.661135:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22640:x1870604236195840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947753.661151:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947753.661163:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c2e expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.661189:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c2e expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.661200:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c2e expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.661209:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a000, rc 0) 00000100:00100000:3.0:1783947753.661255:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236195840:12345-0@lo:101:mount.lustre.0 Request processed in 123us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.661262:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783947753.669112:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947753.669146:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c35 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.669160:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c35 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947753.669250:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947753.669314:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.669351:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947753.669371:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236195968 00000100:00100000:2.0:1783947753.669377:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236195968 00000100:00100000:2.0:1783947753.669425:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947753.669434:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236195968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947753.669587:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236195968:12345-0@lo:501:mount.lustre.0 Request processed in 153us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.669595:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947753.669634:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236195968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947753.669661:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236196096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947753.669700:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.669718:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947753.669730:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196096 00000100:00100000:2.0:1783947753.669733:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196096 00000100:00100000:2.0:1783947753.669751:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947753.669757:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236196096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947753.669829:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236196096:12345-0@lo:503:mount.lustre.0 Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.669841:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947753.669889:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236196096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947753.670614:0:22693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22693:1870604236196224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947753.670660:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.670690:0:22693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc62b4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.670756:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196224 00000100:00100000:3.0:1783947753.670762:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196224 00000100:00100000:3.0:1783947753.670796:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947753.670803:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22693:x1870604236196224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947753.670909:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22693:x1870604236196224:12345-0@lo:502:llog_process_th.0 Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.670916:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947753.671493:0:22693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22693:1870604236196224:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783947753.671551:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783947753.671565:0:22693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e7be7b40000) 00000020:00000080:1.0:1783947753.671591:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783947753.671779:0:22693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bf7a56000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783947753.671784:0:22693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bf7a56000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783947753.671786:0:22693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bf7a56000 4 00010000:00080000:1.0:1783947753.671814:0:22693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7c01bf2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947753.678692:0:22693:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783947753.678819:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783947753.678877:0:22693:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783947753.678890:0:22693:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe6fd1fdb55501c43 00000100:00080000:1.0:1783947753.678901:0:22693:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947753.678906:0:22693:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e7c01bf2000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947753.678940:0:22693:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7be3fb2a00 x1870604236196352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947753.678981:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236196352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783947753.679048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.679113:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196352 00000100:00100000:1.0:1783947753.679120:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196352 00000100:00100000:1.0:1783947753.679149:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947753.679157:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236196352:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783947753.679219:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236196352:12345-0@lo:38:llog_process_th.0 Request processed in 62us (171us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783947753.679226:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947753.679262:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947753.679270:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947753.679284:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783947753.679288:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236196352:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783947753.679316:0:22693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783947753.681713:0:22693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22693:1870604236196480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947753.681785:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.681816:0:22693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7831780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.681936:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196480 00000100:00100000:3.0:1783947753.681944:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196480 00000100:00100000:3.0:1783947753.681990:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947753.681999:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22693:x1870604236196480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947753.682117:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22693:x1870604236196480:12345-0@lo:502:llog_process_th.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.682130:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947753.682225:0:22693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22693:1870604236196480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947753.682264:0:22693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22693:1870604236196608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947753.682294:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947753.682323:0:22693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7831780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.682434:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196608 00000100:00100000:3.0:1783947753.682438:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196608 00000100:00100000:3.0:1783947753.682491:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947753.682499:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22693:x1870604236196608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947753.682568:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22693:x1870604236196608:12345-0@lo:502:llog_process_th.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947753.682574:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947753.683513:0:22693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39423f5f-9729-4dc0-9c01-dc528f57ea81:22693:1870604236196608:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783947753.683541:0:22693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783947753.684477:0:22640:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783947753.684504:0:22640:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947753.684522:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c35 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.684534:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb55501c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c35 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783947753.684582:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783947753.684584:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947753.684585:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947753.684586:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947753.684587:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947753.684589:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947753.684590:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947753.684591:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947753.684593:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947753.684594:0:22640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947753.684598:0:22640:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783947753.684601:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947753.684602:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947753.684603:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947753.684604:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947753.684610:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947753.684611:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947753.684612:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947753.684613:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947753.684614:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947753.684615:0:22640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947753.684637:0:22640:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783947753.684655:0:22640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236196736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783947753.684712:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947753.684743:0:22640:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a8cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947753.684835:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196736 00000100:00100000:1.0:1783947753.684842:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196736 00000100:00100000:1.0:1783947753.684890:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947753.684898:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236196736:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783947753.684923:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783947753.684937:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783947753.689000:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783947753.689015:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783947753.689250:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22640:x1870604236196736:12345-0@lo:253:mount.lustre.0 Request processed in 4347us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947753.689261:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1783947753.689448:0:22677:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783947753.689477:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783947753.689499:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.689516:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 11 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.689525:0:22677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.689560:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 11 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947753.689574:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 11 pid: 22656 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947753.689589:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9351c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236196864:0@lo:104: 00000100:00100000:3.0:1783947753.689623:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947753.689662:0:22677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a8c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947753.689699:0:22640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:22640:1870604236196736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783947753.689711:0:22640:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783947753.689722:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783947753.689724:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947753.689726:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947753.689727:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947753.689728:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947753.689729:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947753.689731:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947753.689732:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947753.689734:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947753.689735:0:22640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783947753.689750:0:22640:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783947753.691980:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196864 00000100:00100000:1.0:1783947753.691994:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196864 00000100:00100000:1.0:1783947753.692045:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947753.692054:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236196864:12345-0@lo:104: 00010000:00010000:1.0:1783947753.692074:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.692167:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947753.692173:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236196864:12345-0@lo:104: Request processed in 120us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947753.692180:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783947753.692201:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947753.692207:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.692215:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947753.692220:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.692229:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947753.692236:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947753.692242:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947753.692282:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.692295:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947753.692315:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.692322:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a400/0xe6fd1fdb55501c12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c19 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947753.692337:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.692339:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947753.692341:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947753.692365:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947753.692378:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236196992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947753.692419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947753.696113:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236196992 00000100:00100000:2.0:1783947753.696131:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236196992 00010000:00010000:2.0:1783947753.696171:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 12 pid: 22656 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947753.696221:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947753.696231:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:3638:x1870604236196992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947753.696264:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947753.696271:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 12 pid: 22656 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696282:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 12 pid: 22656 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696304:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696312:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947753.696329:0:22646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006876623s 00010000:00010000:2.0:1783947753.696333:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696340:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696357:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696363:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696369:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ae00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947753.696373:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696382:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696392:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.696402:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947753.696509:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:3638:x1870604236196992:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947753.696517:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947753.696566:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236196992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947753.701581:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501c12 expref: 11 pid: 22656 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947753.701607:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9351c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236196864:0@lo:104: 00010000:00010000:2.0:1783947753.701635:0:22677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.701664:0:22677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.701671:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947753.701677:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501c4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783947753.730313:0:22640:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1783947753.731018:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783947753.731255:0:22702:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783947753.731370:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1783947753.731706:0:22703:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e7bd9353b80 x1870604236197120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947753.731720:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000020:00080000:1.0:1783947753.731931:0:22701:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1783947753.731935:0:22701:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1783947753.732160:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783947753.732195:0:22640:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783947753.732874:0:22640:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783947753.732883:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783947753.732922:0:22640:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947753.733052:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947753.734080:0:22640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783947753.734726:0:22640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783947753.734760:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783947753.736014:0:22640:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1783947753.736738:0:22640:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:3.0:1783947753.737375:0:22702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783947753.737435:0:22702:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1783947753.738495:0:22640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1783947753.740348:0:22640:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783947753.740385:0:22640:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7948191f988 00100000:10000000:2.0:1783947753.740394:0:22640:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783947753.742086:0:22640:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947753.742102:0:22640:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947753.742119:0:22640:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783947753.742134:0:22640:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783947753.743060:0:22640:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947753.744379:0:22640:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947754.422421:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947754.483537:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947754.483546:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bf7a56000 from 11 10000000:01000000:3.0:1783947754.483551:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947754.483621:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947754.483635:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947754.483646:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947754.483675:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9351c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236197248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947754.483742:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947754.483789:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947754.483789:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197248 00000100:00100000:2.0:1783947754.483797:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197248 00000100:00100000:3.0:1783947754.483978:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947754.483989:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+11:22658:x1870604236197248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947754.484007:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947754.484023:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c51 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947754.484050:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947754.484065:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947754.484074:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ac00, rc 0) 00000100:00100000:3.0:1783947754.484120:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22658:x1870604236197248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947754.484127:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947754.484250:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9351c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236197248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947754.484265:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947754.484274:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947754.484325:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236197376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783947754.484359:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947754.484424:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947754.492932:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197376 00000100:00100000:2.0:1783947754.492954:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197376 00000100:00100000:3.0:1783947754.494483:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947754.494511:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22658:x1870604236197376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783947754.494539:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783947754.494565:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783947754.494569:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1783947754.494731:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:22658:x1870604236197376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 238us (10369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947754.494739:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947754.494785:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236197376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783947754.494840:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947754.494863:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947754.494880:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947754.740042:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000040:00080000:2.0:1783947754.747129:0:22697:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947754.747142:0:22697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947754.748835:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783947754.748856:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1783947755.443756:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947755.763793:0:22697:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947755.763808:0:22697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947755.763998:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1783947755.764050:0:22697:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947755.764928:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1783947755.765989:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783947756.474235:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947756.788638:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783947757.492216:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947757.811904:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783947758.515719:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947758.807644:0:22946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783947758.836658:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000100:00100000:1.0:1783947758.836926:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236197504:0@lo:400:kworker.0 00000100:00100000:1.0:1783947758.836997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947758.837092:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197504 00000100:00100000:3.0:1783947758.837101:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197504 00000100:00100000:3.0:1783947758.837166:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947758.837176:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:3638:x1870604236197504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947758.837238:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:3638:x1870604236197504:12345-0@lo:400:kworker.0 Request processed in 63us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947758.837245:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783947758.837342:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236197504:0@lo:400:kworker.0 00000100:00080000:0.0:1783947758.837978:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783947758.837985:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783947758.837989:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947758.837995:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1783947758.837999:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783947758.838005:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7bc48d6800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947758.838104:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9353800 x1870604236197632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947758.838164:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236197632:0@lo:38:kworker.0 00000100:00100000:1.0:1783947758.838222:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947758.838416:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947758.838421:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947758.838424:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947758.838427:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947758.838429:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783947758.838432:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783947758.838434:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947758.838439:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e7c01bf2000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947758.838485:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9350380 x1870604236197760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947758.838652:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197632 00000100:00100000:0.0:1783947758.838659:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197632 00000100:00100000:0.0:1783947758.838687:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947758.838694:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236197632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783947758.838714:0:22667:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783947758.838793:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236197760:0@lo:38:kworker.0 00000100:00100000:1.0:1783947758.838821:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947758.839985:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197760 00000100:00100000:3.0:1783947758.839996:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197760 00000100:00100000:3.0:1783947758.840040:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947758.840047:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236197760:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783947758.840074:0:22663:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:3.0:1783947758.840111:0:22663:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe6fd1fdb55501c5f 00000004:00100000:3.0:1783947758.840130:0:22663:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947758.840279:0:22663:0:(import.c:65:import_set_state_nolock()) ffff9e7c003fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947758.840357:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870604236197760:12345-0@lo:38:kworker.0 Request processed in 309us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947758.840365:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947758.841193:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236197632:12345-0@lo:38:kworker.0 Request processed in 2494us (2966us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783947758.841211:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783947758.842111:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947758.842120:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947758.842124:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236197632:0@lo:38:kworker.0 00010000:00080000:1.0:1783947758.843612:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7bd9350380 x1870604236197760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783947758.843633:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1783947758.843642:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783947758.843647:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783947758.843651:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783947758.843657:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236197760:0@lo:38:kworker.0 00010000:00010000:1.0:1783947759.540698:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783947759.841417:0:22998:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947759.841816:0:22998:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783947759.861392:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783947760.567856:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947760.902187:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000020:00000004:1.0:1783947760.935506:0:23048:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947760.935858:0:23048:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947761.587787:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947761.916598:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783947762.612016:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947762.934449:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783947763.636687:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947763.955624:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000100:00100000:0.0:1783947763.958709:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947753/real 1783947753] req@ffff9e7bf3485880 x1870604236194688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947763.958750:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf3485880 x1870604236194688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947763.958763:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947753/real 1783947753] req@ffff9e7bf3484e00 x1870604236194560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947763.958777:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf3484e00 x1870604236194560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947763.958809:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947763.960882:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783947763.960890:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783947763.960895:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947763.960907:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:2.0:1783947763.960916:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783947763.960927:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7bc48d6800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947763.960958:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3484700 x1870604236198016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947763.960972:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947763.960977:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947763.960990:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947763.960994:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783947763.960996:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947763.961000:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1783947763.961003:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783947763.961007:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947763.961021:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3484000 x1870604236198144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947763.961112:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236198272:0@lo:400:kworker.0 00000100:00100000:2.0:1783947763.961211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947763.961277:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947763.961284:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236197888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947763.961320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947763.961378:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236198272 00000100:00100000:2.0:1783947763.961389:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236198272 00000100:00100000:2.0:1783947763.961444:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947763.961453:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947763.962744:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236198272:12345-0@lo:400:kworker.0 Request processed in 1282us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947763.962758:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947763.962802:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197888 00000100:00100000:2.0:1783947763.962809:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197888 00000100:00100000:2.0:1783947763.962853:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947763.962861:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:3640:x1870604236197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947763.962908:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:3640:x1870604236197888:12345-0@lo:400:kworker.0 Request processed in 48us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947763.962922:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1783947763.963068:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947763.963076:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236194688:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783947763.963088:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947763.963094:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947763.963097:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236194560:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783947763.963131:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236198016:0@lo:38:kworker.0 00000100:00100000:0.0:1783947763.963176:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947763.963206:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236198144:0@lo:8:kworker.0 00000400:00000100:0.0:1783947763.963230:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236198144 offset 0 length 520: 4 00000100:00100000:0.0:1783947763.963269:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236198016 00000100:00100000:0.0:1783947763.963274:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236198016 00000100:00100000:0.0:1783947763.963301:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947763.963306:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236198016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783947763.963327:0:22666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783947763.963367:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236198016:12345-0@lo:38:kworker.0 Request processed in 59us (190us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783947763.963374:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783947763.963416:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947763.963421:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783947763.963424:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236198016:0@lo:38:kworker.0 00000100:00080000:2.0:1783947763.963546:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947763.963552:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783947763.963559:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947763.963564:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1783947763.963568:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783947763.963573:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bc48d2000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947763.963607:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3485500 x1870604236198400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947763.965861:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236198400:0@lo:8:kworker.0 00000400:00000100:0.0:1783947763.965979:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236198400 offset 0 length 520: 4 00010000:00080000:3.0:1783947763.968692:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7bf3486d80 x1870604236198272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947763.968779:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236198272:0@lo:400:kworker.0 00000100:00100000:3.0:1783947763.968818:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236197888:0@lo:400:kworker.0 00010000:00010000:3.0:1783947764.659904:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947764.981889:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783947765.692259:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947766.004879:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000040:00080000:2.0:1783947766.005931:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947766.709844:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947767.027724:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000020:01000004:1.0:1783947767.667825:0:23393:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783947767.667829:0:23393:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783947767.667830:0:23393:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783947767.667971:0:23393:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7be7b4d000 00000020:01000004:1.0:1783947767.667990:0:23393:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1783947767.668003:0:23393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783947767.668029:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e7be7b419c0) 00000020:00000080:1.0:1783947767.668049:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1783947767.731994:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1783947767.750933:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.751510:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783947767.752130:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783947767.752333:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783947767.752817:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783947767.753016:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783947767.753244:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783947767.753408:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1783947767.753789:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783947767.753987:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783947767.754193:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783947767.754422:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1783947767.754728:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1783947767.754970:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783947767.755443:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.755908:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.756542:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.756817:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.757094:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.757329:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.757839:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.758043:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.758351:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.758600:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.758889:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.759136:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.759371:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.759631:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.759903:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.760149:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.760346:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.762635:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.763414:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.765233:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.768054:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.768486:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.768982:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.769258:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.769512:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.769731:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.770043:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.770305:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.770545:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.773774:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783947767.774699:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1783947767.775008:0:23393:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00080000:01000000:0.0:1783947767.778068:0:23393:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783947767.778325:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1783947767.778339:0:23393:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783947767.778350:0:23393:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501c6d 00000020:01000004:0.0:1783947767.778357:0:23393:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783947767.778383:0:23393:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783947767.778387:0:23393:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783947767.778402:0:23393:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1783947767.778430:0:23393:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1783947767.778434:0:23393:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783947767.785236:0:23393:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783947767.785276:0:23393:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1783947767.785281:0:23393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783947767.785282:0:23393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783947767.785284:0:23393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947767.785285:0:23393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947767.785287:0:23393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947767.785288:0:23393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947767.785290:0:23393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783947767.785292:0:23393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947767.785294:0:23393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947767.785297:0:23393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1783947767.785300:0:23393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947767.785301:0:23393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783947767.785302:0:23393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947767.785303:0:23393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947767.785304:0:23393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947767.785306:0:23393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947767.785307:0:23393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783947767.785312:0:23393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947767.785313:0:23393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947767.785342:0:23393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783947767.785365:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947767.785442:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947767.785517:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651000 going to sleep for 11 seconds 00000100:00100000:1.0:1783947767.785601:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236198528 00000100:00100000:1.0:1783947767.785615:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236198528 00000100:00100000:1.0:1783947767.785674:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783947767.785684:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:23393:x1870604236198528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783947767.785720:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783947767.785724:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1783947767.785732:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783947767.786123:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:23393:x1870604236198528:12345-0@lo:253:mount.lustre.0 Request processed in 429us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947767.786133:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947767.786284:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198528:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783947767.786294:0:23393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783947767.786297:0:23393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947767.786298:0:23393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947767.786300:0:23393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947767.786301:0:23393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947767.786302:0:23393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947767.786303:0:23393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947767.786305:0:23393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947767.786306:0:23393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947767.786307:0:23393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783947767.786327:0:23393:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7be7b4d000 from lustre-MDT0001 10000000:01000000:0.0:1783947767.786370:0:23393:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1783947767.786374:0:23393:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783947767.786382:0:23393:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7bc47bb380 local copy 00010000:00010000:0.0:1783947767.786392:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947767.786524:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947767.786560:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.786606:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947767.786667:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236198656 00000100:00100000:3.0:1783947767.786673:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236198656 00000100:00100000:3.0:1783947767.786701:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947767.786709:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:23393:x1870604236198656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947767.786795:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:23393:x1870604236198656:12345-0@lo:501:mount.lustre.0 Request processed in 86us (234us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947767.786802:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947767.786962:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198656:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783947767.786991:0:23393:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783947767.787009:0:23393:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783947767.787016:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.787025:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.787058:0:23393:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7be7b4d000 10000000:01000000:0.0:1783947767.787063:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947767.787078:0:23393:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e7bc47bb380 10000000:01000000:0.0:1783947767.787082:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783947767.787085:0:23393:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e7bc47bb380 from 1 10000000:01000000:0.0:1783947767.787088:0:23393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783947767.787112:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.787130:0:23393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.787141:0:23393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947767.787154:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947767.787179:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.787199:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947767.787304:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236198784 00000100:00100000:3.0:1783947767.787308:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236198784 00000100:00100000:3.0:1783947767.787341:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947767.787348:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+12:23393:x1870604236198784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947767.787358:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947767.787373:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846b000/0xe6fd1fdb55501c7b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c74 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.787394:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846b000/0xe6fd1fdb55501c7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c74 expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.787405:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846b000/0xe6fd1fdb55501c7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c74 expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.787413:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b000, rc 0) 00000100:00100000:3.0:1783947767.787451:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+13:23393:x1870604236198784:12345-0@lo:101:mount.lustre.0 Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.787487:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947767.789389:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947767.789415:0:23393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c7b expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.789427:0:23393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c7b expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.789476:0:23393:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783947767.789488:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c7b expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.789517:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55501c74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c7b expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.789529:0:23393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e7be7b4d000 10000000:01000000:0.0:1783947767.789534:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783947767.789539:0:23393:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e7be7b4d000 from 1 10000000:01000000:0.0:1783947767.789542:0:23393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783947767.789572:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.789579:0:23393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.789603:0:23393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947767.789625:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947767.789677:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.789711:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947767.789791:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236198912 00000100:00100000:2.0:1783947767.789797:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236198912 00000100:00100000:2.0:1783947767.789848:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947767.789857:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+13:23393:x1870604236198912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947767.789870:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947767.789882:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55501c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c82 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947767.789902:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55501c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c82 expref: 14 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947767.789912:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55501c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c82 expref: 14 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947767.789920:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e600, rc 0) 00000100:00100000:2.0:1783947767.789957:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+14:23393:x1870604236198912:12345-0@lo:101:mount.lustre.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.789964:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947767.790222:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236198912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947767.790233:0:23393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c89 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.790242:0:23393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c89 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.790261:0:23393:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783947767.790265:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c89 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.790280:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb55501c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c89 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.790287:0:23393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783947767.790290:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947767.790295:0:23393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e7be7b4d000 10000000:01000000:0.0:1783947767.790297:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783947767.790300:0:23393:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1783947767.790302:0:23393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783947767.790321:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.790327:0:23393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.790334:0:23393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947767.790345:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947767.790372:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.790395:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947767.790488:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199040 00000100:00100000:3.0:1783947767.790492:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199040 00000100:00100000:3.0:1783947767.790520:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947767.790527:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+14:23393:x1870604236199040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947767.790534:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947767.790543:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846aa00/0xe6fd1fdb55501c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501c90 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.790566:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846aa00/0xe6fd1fdb55501c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c90 expref: 15 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.790575:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846aa00/0xe6fd1fdb55501c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c90 expref: 15 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.790582:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846aa00, rc 0) 00000100:00100000:3.0:1783947767.790626:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199040:12345-0@lo:101:mount.lustre.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.790632:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947767.790878:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947767.790890:0:23393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c97 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.790897:0:23393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501c97 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947767.792953:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1783947767.793811:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947767.799252:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1783947767.799325:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1783947767.799341:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1783947767.799354:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1783947767.799367:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1783947767.799381:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1783947767.799395:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1783947767.799408:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1783947767.799419:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1783947767.799434:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1783947767.799445:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1783947767.799666:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1783947767.799687:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1783947767.799699:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1783947767.799714:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1783947767.799729:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1783947767.799742:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1783947767.799754:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1783947767.799768:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1783947767.799781:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1783947767.799808:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1783947767.799820:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1783947767.799831:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1783947767.799842:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1783947767.799855:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1783947767.799866:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1783947767.799877:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1783947767.799891:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1783947767.799903:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1783947767.799915:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1783947767.799928:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1783947767.799943:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1783947767.799957:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1783947767.799971:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1783947767.799985:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1783947767.799996:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1783947767.800008:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1783947767.800019:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1783947767.800030:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1783947767.800043:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1783947767.800056:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1783947767.800068:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1783947767.800196:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1783947767.800209:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1783947767.800235:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1783947767.800241:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1783947767.800372:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947767.800449:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.800878:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.800945:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199168 00000100:00100000:0.0:1783947767.800953:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199168 00000100:00100000:0.0:1783947767.801042:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947767.801053:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947767.801228:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199168:12345-0@lo:501:mount.lustre.0 Request processed in 177us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.801235:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783947767.801318:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947767.801358:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947767.801415:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.801922:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947767.801988:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199296 00000100:00100000:2.0:1783947767.801993:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199296 00000100:00100000:2.0:1783947767.802022:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947767.802028:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947767.802859:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199296:12345-0@lo:503:mount.lustre.0 Request processed in 827us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.802869:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947767.803044:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783947767.803840:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947767.803924:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947767.803977:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.804045:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947767.804198:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199424 00000100:00100000:2.0:1783947767.804204:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199424 00000100:00100000:2.0:1783947767.804274:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947767.804282:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947767.804980:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199424:12345-0@lo:502:mount.lustre.0 Request processed in 697us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.804990:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947767.805088:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947767.805325:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1783947767.805353:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1783947767.805365:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1783947767.805376:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1783947767.805387:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1783947767.805398:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1783947767.805409:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1783947767.805420:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1783947767.805430:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1783947767.805441:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1783947767.805451:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1783947767.805501:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1783947767.805513:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1783947767.805524:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1783947767.805535:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1783947767.805546:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1783947767.805558:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1783947767.805569:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1783947767.805579:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1783947767.805602:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1783947767.805615:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1783947767.805634:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1783947767.805645:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1783947767.805656:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1783947767.805667:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1783947767.805677:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1783947767.805688:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1783947767.805700:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1783947767.805711:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1783947767.805723:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1783947767.805735:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1783947767.805747:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1783947767.805758:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1783947767.805769:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1783947767.805780:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1783947767.805791:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1783947767.805802:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1783947767.805813:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1783947767.805823:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1783947767.805836:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1783947767.805846:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1783947767.805857:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1783947767.805868:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1783947767.805881:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1783947767.805919:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947767.805971:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.806430:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947767.806578:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199552 00000100:00100000:1.0:1783947767.806594:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199552 00000100:00100000:1.0:1783947767.806639:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947767.806648:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947767.806798:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236199552:12345-0@lo:502:mount.lustre.0 Request processed in 150us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947767.806806:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947767.806940:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236199552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947767.806994:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1783947767.807004:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1783947767.807917:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.807930:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.807941:0:23397:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1783947767.807947:0:23397:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1783947767.807950:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947767.807965:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e7be3f33380) 00000020:00000080:3.0:1783947767.807987:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1783947767.807992:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783947767.808068:0:23397:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947767.808203:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501ca5 00000020:00000080:3.0:1783947767.808404:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1783947767.808409:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.808413:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.808414:0:23397:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1783947767.808416:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.808420:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.808421:0:23397:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1783947767.808424:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947767.808431:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e7be3f30000) 00000020:00000080:3.0:1783947767.808441:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1783947767.808445:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783947767.808447:0:23397:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1783947767.808450:0:23397:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1783947767.808541:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783947767.808619:0:23397:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7be7b4d000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1783947767.808632:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e7bc5513380) 00000020:00000080:3.0:1783947767.808640:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1783947767.808697:0:23397:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783947767.808703:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501cba 00000020:00000080:3.0:1783947767.808796:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1783947767.808803:0:23397:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783947767.808807:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe6fd1fdb55501cc1 00080000:01000000:3.0:1783947767.808813:0:23397:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783947767.808816:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501cc8 00010000:00010000:2.0:1783947767.885269:0:23397:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1783947767.886241:0:23397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1783947767.886597:0:23397:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783947767.887745:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783947767.887759:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947767.887766:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947767.887768:0:23397:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783947767.887773:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947767.887779:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947767.887780:0:23397:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783947767.887783:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783947767.887788:0:23397:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:1.0:1783947767.887818:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947767.887836:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e7be7b44d40) 00000020:00000080:1.0:1783947767.887859:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1783947767.887864:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783947767.887943:0:23397:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783947767.887951:0:23397:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783947767.887958:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501cd6 00010000:00080000:1.0:1783947767.888001:0:23397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac588a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947767.892883:0:23397:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1783947767.899329:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947767.899353:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783947767.899397:0:23397:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783947767.899421:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501cdd 00000100:00080000:3.0:1783947767.899432:0:23397:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947767.899438:0:23397:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e7ac588a000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947767.899547:0:23397:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9352d80 x1870604236199680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947767.899575:0:23397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1783947767.899688:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.899692:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.899694:0:23397:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783947767.899697:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783947767.899700:0:23397:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783947767.899702:0:23397:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947767.899703:0:23397:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947767.899705:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783947767.899707:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.899708:0:23397:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783947767.899711:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.899716:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.899717:0:23397:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783947767.899721:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783947767.899761:0:23397:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783947767.899774:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.899778:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.899779:0:23397:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783947767.899781:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783947767.899783:0:23397:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783947767.899784:0:23397:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947767.899785:0:23397:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947767.899787:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783947767.899789:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.899796:0:23397:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783947767.899799:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783947767.899802:0:23397:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783947767.899806:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.899807:0:23397:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783947767.899810:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783947767.899814:0:23397:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:3.0:1783947767.899838:0:23397:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783947767.899841:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947767.899853:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e7bc5514d40) 00000020:00000080:3.0:1783947767.899866:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783947767.899871:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783947767.899944:0:23397:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1783947767.899951:0:23397:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783947767.899958:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501ceb 00010000:00080000:3.0:1783947767.899990:0:23397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bf34ca000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947767.900351:0:23397:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1783947767.900728:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236199680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783947767.900823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.901370:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199680 00000100:00100000:3.0:1783947767.901381:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199680 00000100:00100000:3.0:1783947767.901421:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947767.901429:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236199680:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783947767.901491:0:22666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:3.0:1783947767.901529:0:22666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501cf2 00000004:00100000:3.0:1783947767.901550:0:22666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783947767.901570:0:22666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:0.0:1783947767.902574:0:23397:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783947767.902931:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1783947767.905507:0:22666:0:(import.c:65:import_set_state_nolock()) ffff9e7ac588a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947767.905637:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236199680:12345-0@lo:38:llog_process_th.0 Request processed in 4205us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.905648:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947767.905833:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947767.905844:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783947767.905854:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783947767.905860:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783947767.905863:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac588a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783947767.905881:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236199680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783947767.906245:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947767.906258:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236199808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947767.906305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.906345:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199808 00000100:00100000:3.0:1783947767.906352:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199808 00000100:00100000:3.0:1783947767.906395:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947767.906405:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236199808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947767.906436:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947767.906506:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236199808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.906513:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947767.906544:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236199808:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1783947767.906720:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1783947767.907077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783947767.907083:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783947767.907086:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947767.907091:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:2.0:1783947767.907097:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783947767.907103:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7bc48d6800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947767.907217:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3486d80 x1870604236199936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947767.907242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947767.907246:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947767.907248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947767.907258:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783947767.907365:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947767.907378:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236200064:0@lo:400:kworker.0 00000100:00100000:1.0:1783947767.907429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.907666:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236199936:0@lo:38:kworker.0 00000100:00100000:0.0:1783947767.907703:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947767.907843:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236200064 00000100:00100000:2.0:1783947767.907849:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236200064 00000100:00100000:2.0:1783947767.907894:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947767.907904:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947767.907956:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236200064:12345-0@lo:400:kworker.0 Request processed in 54us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.907962:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783947767.908296:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7bf3484700 x1870604236200064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947767.908310:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236200064:0@lo:400:kworker.0 00000100:00100000:1.0:1783947767.908334:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236199936 00000100:00100000:1.0:1783947767.908338:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236199936 00000100:00100000:1.0:1783947767.908357:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947767.908362:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236199936:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783947767.908409:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236199936:12345-0@lo:38:kworker.0 Request processed in 45us (704us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783947767.908415:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947767.908525:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947767.908532:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947767.908536:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783947767.908538:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236199936:0@lo:38:kworker.0 00000040:00080000:1.0:1783947767.909619:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1783947767.910168:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783947767.910899:0:23402:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783947767.910905:0:23402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783947767.911991:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947767.912005:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783947767.912058:0:23397:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783947767.912223:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501cf9 00000100:00080000:0.0:1783947767.912233:0:23397:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947767.912239:0:23397:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7bf34ca000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947767.912273:0:23397:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a16d80 x1870604236200192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947767.912342:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236200192:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783947767.912417:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236200192 offset 0 length 520: 4 00000100:00080000:0.0:1783947767.912523:0:23397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783947767.912580:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947767.912595:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.912597:0:23397:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783947767.912600:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783947767.912603:0:23397:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1783947767.912605:0:23397:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947767.912606:0:23397:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947767.912608:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783947767.912610:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.912611:0:23397:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783947767.912613:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947767.912617:0:23397:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783947767.912621:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.912622:0:23397:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783947767.912625:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947767.912628:0:23397:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:0.0:1783947767.912647:0:23397:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783947767.912649:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947767.912659:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e7c01b899c0) 00000020:00000080:0.0:1783947767.912671:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1783947767.912676:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947767.912746:0:23397:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1783947767.912754:0:23397:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783947767.912760:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501d07 00010000:00080000:0.0:1783947767.912789:0:23397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc4cba000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1783947767.912981:0:23397:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1783947767.913043:0:23397:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783947767.913057:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1783947767.913258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947767.913263:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947767.913266:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947767.913269:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1783947767.915271:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947767.915600:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1783947767.915829:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1783947767.916527:0:23404:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783947767.916533:0:23404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783947767.917400:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947767.917411:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783947767.917446:0:23397:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783947767.917604:0:23397:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501d0e 00000100:00080000:0.0:1783947767.917615:0:23397:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947767.917621:0:23397:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947767.917658:0:23397:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a17800 x1870604236200320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947767.917714:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236200320:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783947767.917778:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236200320 offset 0 length 520: 4 00000100:00080000:0.0:1783947767.917881:0:23397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783947767.917965:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947767.917968:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.917970:0:23397:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783947767.917973:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947767.917976:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.917978:0:23397:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783947767.917980:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783947767.917982:0:23397:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783947767.917984:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947767.917986:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.917987:0:23397:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783947767.917989:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947767.917991:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.917992:0:23397:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783947767.917995:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783947767.918017:0:23397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947767.918019:0:23397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947767.918020:0:23397:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783947767.918023:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1783947767.918240:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947767.918245:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947767.918247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947767.918250:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1783947767.918346:0:23393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1783947767.918372:0:23393:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783947767.918392:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c97 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.918403:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb55501c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501c97 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947767.918411:0:23393:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be7b4d000 from 1 10000000:01000000:1.0:1783947767.918413:0:23393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947767.918437:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.918445:0:23393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.918477:0:23393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947767.918493:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947767.918527:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947767.918600:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd5c46540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947767.918729:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236200448 00000100:00100000:2.0:1783947767.918795:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236200448 00000100:00100000:2.0:1783947767.918875:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783947767.918886:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+15:23393:x1870604236200448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947767.918899:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947767.918924:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d15 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947767.918947:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947767.918956:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947767.918965:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e800, rc 0) 00000100:00100000:2.0:1783947767.919009:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:23393:x1870604236200448:12345-0@lo:101:mount.lustre.0 Request processed in 125us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.919016:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947767.919097:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947767.919110:0:23393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.919134:0:23393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947767.919746:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200576:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783947767.919791:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.924190:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236200576 00000100:00100000:3.0:1783947767.924206:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236200576 00000100:00100000:3.0:1783947767.924260:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947767.924270:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:23393:x1870604236200576:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783947767.924297:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783947767.924320:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783947767.924324:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1783947767.924444:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:23393:x1870604236200576:12345-0@lo:256:mount.lustre.0 Request processed in 174us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.924452:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947767.924900:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd5c46540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947767.924927:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200576:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783947767.925846:0:23393:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947767.925904:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.925917:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947767.925927:0:23393:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be7b4d000 from 1 10000000:01000000:1.0:1783947767.925930:0:23393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947767.925965:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.925973:0:23393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.925983:0:23393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947767.926005:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947767.926052:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947767.926198:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd5c46540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947767.926273:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236200704 00000100:00100000:3.0:1783947767.926279:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236200704 00000100:00100000:3.0:1783947767.926358:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947767.926368:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:23393:x1870604236200704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947767.926389:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947767.926403:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d23 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.926425:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.926434:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.926442:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:3.0:1783947767.926515:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236200704:12345-0@lo:101:mount.lustre.0 Request processed in 148us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.926521:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947767.926605:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947767.926619:0:23393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.926627:0:23393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947767.928907:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1783947767.929845:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947767.930057:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1783947767.930084:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1783947767.930100:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1783947767.930340:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1783947767.930361:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1783947767.930374:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1783947767.930386:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1783947767.930395:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1783947767.930405:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1783947767.930415:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1783947767.930426:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1783947767.930443:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1783947767.930448:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1783947767.930798:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947767.930868:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947767.931191:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5dc49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947767.931268:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236200832 00000100:00100000:2.0:1783947767.931276:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236200832 00000100:00100000:2.0:1783947767.931370:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947767.931380:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236200832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947767.931651:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236200832:12345-0@lo:501:mount.lustre.0 Request processed in 272us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.931660:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947767.931848:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947767.931919:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947767.931964:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.932148:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947767.932284:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236200960 00000100:00100000:1.0:1783947767.932289:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236200960 00000100:00100000:1.0:1783947767.932316:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947767.932322:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236200960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947767.932413:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236200960:12345-0@lo:503:mount.lustre.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947767.932420:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947767.932528:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236200960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783947767.933057:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947767.933276:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947767.933316:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.933391:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be4424cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947767.933441:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201088 00000100:00100000:2.0:1783947767.933447:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201088 00000100:00100000:0.0:1783947767.933530:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947767.933541:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236201088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.933662:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236201088:12345-0@lo:502:mount.lustre.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.933669:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947767.933764:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947767.933950:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783947767.933978:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1783947767.934003:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1783947767.934016:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1783947767.934029:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1783947767.934041:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1783947767.934052:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1783947767.934065:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1783947767.934079:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783947767.934092:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1783947767.934105:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1783947767.934308:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947767.934348:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947767.934552:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be4424cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947767.934613:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201216 00000100:00100000:1.0:1783947767.934618:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201216 00000100:00100000:1.0:1783947767.934646:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947767.934653:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236201216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947767.934757:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236201216:12345-0@lo:502:mount.lustre.0 Request processed in 103us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947767.934764:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783947767.934901:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947767.934946:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1783947767.934956:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783947767.935701:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.935711:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935713:0:23406:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947767.935720:0:23406:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7be7b4d000 00000020:00000080:3.0:1783947767.935723:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947767.935741:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.935744:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935745:0:23406:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783947767.935748:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.935751:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935752:0:23406:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947767.935755:0:23406:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7be7b4d000 00000020:00000080:3.0:1783947767.935758:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947767.935828:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.935832:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935834:0:23406:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783947767.935843:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.935846:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935847:0:23406:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947767.935851:0:23406:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7be7b4d000 00000020:00000080:3.0:1783947767.935853:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947767.935874:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.935877:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935878:0:23406:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947767.935881:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947767.935884:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935885:0:23406:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783947767.935889:0:23406:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7be7b4d000 00000020:00000080:3.0:1783947767.935890:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947767.935915:0:23406:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947767.935918:0:23406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947767.935920:0:23406:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783947767.935923:0:23406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1783947767.943983:0:23393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783947767.944035:0:23393:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947767.944102:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.944128:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947767.944200:0:23393:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783947767.944204:0:23393:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7be7b4d000 10000000:01000000:1.0:1783947767.944207:0:23393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7be7b4d000 10000000:01000000:1.0:1783947767.944212:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947767.944217:0:23393:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7be7b4d000 from 1 10000000:01000000:1.0:1783947767.944220:0:23393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947767.944263:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.944273:0:23393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.944294:0:23393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947767.944323:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947767.944405:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947767.944484:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc62b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947767.945218:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201344 00000100:00100000:3.0:1783947767.945228:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201344 00000100:00100000:3.0:1783947767.945280:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783947767.945290:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:23393:x1870604236201344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947767.945305:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947767.945323:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a400/0xe6fd1fdb55501d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d31 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.945348:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a400/0xe6fd1fdb55501d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d31 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.945358:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846a400/0xe6fd1fdb55501d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d31 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947767.945367:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a400, rc 0) 00000100:00100000:3.0:1783947767.945433:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201344:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947767.945440:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947767.945566:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947767.945582:0:23393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d38 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947767.945603:0:23393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d38 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947767.952620:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1783947767.952955:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947767.954069:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1783947767.954194:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1783947767.954219:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1783947767.954235:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1783947767.954249:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1783947767.954263:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1783947767.954277:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1783947767.954293:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1783947767.954307:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1783947767.954321:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1783947767.954335:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1783947767.954349:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1783947767.954362:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1783947767.954375:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1783947767.954390:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1783947767.954404:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1783947767.954418:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1783947767.954433:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1783947767.954448:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1783947767.954491:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1783947767.954507:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1783947767.954521:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1783947767.954535:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1783947767.954570:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1783947767.954599:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1783947767.954616:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1783947767.954640:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1783947767.954654:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1783947767.954668:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1783947767.954681:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1783947767.954696:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1783947767.954708:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1783947767.954721:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1783947767.954733:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1783947767.954745:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1783947767.954757:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1783947767.954769:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1783947767.954782:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1783947767.954794:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1783947767.954821:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1783947767.954837:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1783947767.954850:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1783947767.954863:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1783947767.954877:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1783947767.954891:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1783947767.954904:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1783947767.954916:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1783947767.954929:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1783947767.955078:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1783947767.955099:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1783947767.957405:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1783947767.957429:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1783947767.957553:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947767.957631:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.957668:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd001a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.957696:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201472 00000100:00100000:0.0:1783947767.957702:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201472 00000100:00100000:0.0:1783947767.957751:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947767.957767:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947767.957875:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201472:12345-0@lo:501:mount.lustre.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.957883:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947767.957927:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947767.957969:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947767.958002:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.958014:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd001a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.958026:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201600 00000100:00100000:0.0:1783947767.958029:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201600 00000100:00100000:0.0:1783947767.958046:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783947767.958051:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947767.961405:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201600:12345-0@lo:503:mount.lustre.0 Request processed in 3341us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.961418:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783947767.961543:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783947767.963021:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947767.966257:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.966351:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.966401:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd001a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.966433:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201728 00000100:00100000:0.0:1783947767.966441:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201728 00000100:00100000:0.0:1783947767.966511:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947767.966519:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.966657:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201728:12345-0@lo:502:mount.lustre.0 Request processed in 138us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.966670:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947767.966733:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947767.966976:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1783947767.967008:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1783947767.967023:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1783947767.967035:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1783947767.967048:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1783947767.967062:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1783947767.967075:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1783947767.967088:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1783947767.967101:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1783947767.968651:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1783947767.968698:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1783947767.968713:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1783947767.968725:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1783947767.968738:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1783947767.968750:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1783947767.968763:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1783947767.968792:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1783947767.968808:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1783947767.968820:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1783947767.968832:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1783947767.968844:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1783947767.968856:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1783947767.968868:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1783947767.968882:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1783947767.968894:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1783947767.968908:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1783947767.968922:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1783947767.968934:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1783947767.968956:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1783947767.968967:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1783947767.968977:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1783947767.968988:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1783947767.969009:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1783947767.969022:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1783947767.969034:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1783947767.969046:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1783947767.969057:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1783947767.970265:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1783947767.970310:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1783947767.970326:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1783947767.970340:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1783947767.970354:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1783947767.970369:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1783947767.970381:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1783947767.970394:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1783947767.970406:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1783947767.970418:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1783947767.970432:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1783947767.970547:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.970635:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.970694:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201856 00000100:00100000:0.0:1783947767.970701:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201856 00000100:00100000:0.0:1783947767.970745:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947767.970753:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.970863:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201856:12345-0@lo:502:mount.lustre.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.970870:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947767.970923:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd001a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.970948:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947767.975534:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1783947767.975629:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1783947767.975685:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.975811:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.975849:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236201984 00000100:00100000:0.0:1783947767.975856:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236201984 00000100:00100000:0.0:1783947767.975899:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783947767.975909:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947767.976016:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236201984:12345-0@lo:502:mount.lustre.0 Request processed in 108us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.976024:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783947767.976091:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd001a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.977092:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236201984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947767.977212:0:23393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1783947767.977225:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783947767.978990:0:23411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783947767.979008:0:23411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e7c01b8b380) 00000020:00000080:0.0:1783947767.979034:0:23411:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783947767.979266:0:23411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7be7b4d000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783947767.979271:0:23411:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7be7b4d000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783947767.979273:0:23411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7be7b4d000 3 00010000:00080000:0.0:1783947767.979319:0:23411:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac6749800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1783947767.986402:0:23411:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783947767.986547:0:23411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783947767.986603:0:23411:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783947767.986615:0:23411:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe6fd1fdb55501d46 00000100:00080000:0.0:1783947767.986630:0:23411:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947767.986636:0:23411:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e7ac6749800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947767.986669:0:23411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a15c00 x1870604236202112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947767.986703:0:23411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947767.986743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947767.986747:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947767.986750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947767.986752:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783947767.986950:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236202112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947767.987018:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.988329:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202112 00000100:00100000:0.0:1783947767.988341:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202112 00000100:00100000:0.0:1783947767.988385:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947767.988393:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236202112:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783947767.988423:0:22663:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:0.0:1783947767.988477:0:22663:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe6fd1fdb55501d4d 00000004:00100000:0.0:1783947767.988492:0:22663:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947767.988523:0:22663:0:(import.c:65:import_set_state_nolock()) ffff9e7ac6748800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947767.988608:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870604236202112:12345-0@lo:38:llog_process_th.0 Request processed in 214us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.988615:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947767.988665:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7bf7a15c00 x1870604236202112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947767.988675:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947767.988684:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783947767.988691:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783947767.988702:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947767.988705:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac6749800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947767.988711:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236202112:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783947767.988831:0:23411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1783947767.988880:0:23393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783947767.988917:0:23393:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947767.988933:0:23393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d38 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.988944:0:23393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438e00/0xe6fd1fdb55501d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d38 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783947767.988991:0:23393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783947767.988993:0:23393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947767.988995:0:23393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947767.988996:0:23393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947767.988997:0:23393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947767.988999:0:23393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947767.989000:0:23393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947767.989002:0:23393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947767.989003:0:23393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947767.989007:0:23393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1783947767.989010:0:23393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947767.989011:0:23393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947767.989012:0:23393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947767.989013:0:23393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947767.989014:0:23393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947767.989015:0:23393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947767.989016:0:23393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947767.989017:0:23393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947767.989018:0:23393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947767.989035:0:23393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783947767.989051:0:23393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236202240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947767.989103:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.990346:0:23393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd001acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.990382:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202240 00000100:00100000:0.0:1783947767.990390:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202240 00000100:00100000:0.0:1783947767.990435:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783947767.990442:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236202240:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947767.990486:0:22656:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783947767.990502:0:22656:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783947767.994473:0:22641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783947767.994752:0:22656:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783947767.994765:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783947767.994839:0:22677:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947767.994844:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947767.994867:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.994887:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.994895:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.994903:0:22677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.994944:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.994960:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 18 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947767.994975:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236202368:0@lo:104: 00000100:00100000:0.0:1783947767.995039:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947767.995102:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.996810:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 18 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947767.996842:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236202496:0@lo:104: 00000100:00100000:0.0:1783947767.996901:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.996950:0:22677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5dc43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947767.996997:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202368 00000100:00100000:0.0:1783947767.997006:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202368 00000100:00100000:0.0:1783947767.997039:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202496 00000100:00100000:0.0:1783947767.997042:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202496 00000100:00100000:0.0:1783947767.997057:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947767.997066:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:22677:x1870604236202368:12345-0@lo:104: 00010000:00010000:0.0:1783947767.997085:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997666:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947767.997674:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:22677:x1870604236202368:12345-0@lo:104: Request processed in 609us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.997683:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947767.997706:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947767.997713:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236202496:12345-0@lo:104: 00010000:00010000:0.0:1783947767.997722:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997760:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947767.997765:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236202496:12345-0@lo:104: Request processed in 54us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947767.997781:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783947767.997802:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947767.997809:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997817:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947767.997821:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997830:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947767.997839:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.997845:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947767.997880:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997887:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947767.997908:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997915:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55501d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d1c expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997928:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947767.997931:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997946:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947767.997949:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997956:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947767.997963:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947767.997967:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947767.997980:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997986:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947767.997992:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.997998:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b600/0xe6fd1fdb55501c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c58 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947767.998012:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947767.998014:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947767.998016:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947767.998023:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947767.998044:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236202624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947767.998074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947767.998108:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947767.999606:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:23393:x1870604236202240:12345-0@lo:253:mount.lustre.0 Request processed in 9156us (10494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947767.999618:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947767.999678:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236202368:0@lo:104: 00000100:00100000:2.0:1783947767.999696:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236202496:0@lo:104: 00010000:00010000:2.0:1783947767.999734:0:22677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947768.000046:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236202752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947768.000093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947768.000299:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202624 00000100:00100000:0.0:1783947768.000306:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202624 00010000:00010000:0.0:1783947768.000334:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 18 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947768.002887:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202752 00000100:00100000:0.0:1783947768.002902:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202752 00010000:00010000:0.0:1783947768.002941:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 19 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947768.003283:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947768.003297:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:3639:x1870604236202624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947768.003314:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947768.003322:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 19 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003335:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 19 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003353:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb55501d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501d15 expref: 19 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003369:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947768.003444:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:3639:x1870604236202624:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (5369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947768.003451:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947768.003492:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947768.003499:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:3639:x1870604236202752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947768.003507:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947768.003512:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 17 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003521:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 17 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003545:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501c51 expref: 17 pid: 22656 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003557:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003565:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947768.003592:0:22648:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008737447s 00010000:00010000:2.0:1783947768.003598:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003605:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003612:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003619:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003625:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947768.003630:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003638:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003651:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003668:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947768.003693:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:3639:x1870604236202752:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947768.003701:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783947768.003726:0:22677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003734:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947768.003741:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55501d54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947768.004896:0:23393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:23393:1870604236202240:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947768.004913:0:23393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783947768.004916:0:23393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947768.004918:0:23393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783947768.004919:0:23393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947768.004920:0:23393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947768.004921:0:23393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947768.004922:0:23393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947768.004924:0:23393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947768.004925:0:23393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947768.004927:0:23393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783947768.004954:0:23393:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783947768.006012:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236202752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947768.006027:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236202624:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1783947768.008768:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1783947768.008860:0:23418:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1783947768.008863:0:23418:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783947768.009827:0:23419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1783947768.011311:0:23419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783947768.013241:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1783947768.013685:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1870604236202880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783947768.013752:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947768.013785:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738900 going to sleep for 11 seconds 00000040:01000000:0.0:1783947768.013945:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1783947768.013977:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783947768.015291:0:23393:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783947768.015308:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1783947768.015373:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947768.015662:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236202880 00000100:00100000:1.0:1783947768.015671:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236202880 00000040:00080000:3.0:1783947768.017257:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783947768.017328:0:23419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1783947768.017574:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947768.017613:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1870604236202880:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947768.017744:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1870604236202880:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 138us (3990us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947768.017752:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1783947768.017841:0:23393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783947768.018493:0:23393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783947768.018533:0:23393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783947768.018656:0:23393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947768.019618:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1870604236202880:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1783947768.019662:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783947768.019713:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1870604236203008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783947768.019772:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1783947768.019917:0:23393:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1783947768.020257:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947768.020774:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203008 00000100:00100000:1.0:1783947768.020781:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203008 00000100:00100000:1.0:1783947768.020824:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947768.020833:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1870604236203008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947768.021002:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1870604236203008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 169us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947768.021010:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947768.021241:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1870604236203008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783947768.021316:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23420:1870604236203136:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783947768.021350:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947768.021376:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947768.021435:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203136 00000100:00100000:1.0:1783947768.021439:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203136 00000100:00100000:1.0:1783947768.021499:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947768.021507:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1870604236203136:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783947768.021552:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1870604236203136:12345-0@lo:900:lod0001_rec0000.0 Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947768.021559:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783947768.022244:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7bf3485880 x1870604236203136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947784 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947768.022264:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23420:1870604236203136:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783947768.022329:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1870604236203264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783947768.022363:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947768.022380:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738900 going to sleep for 11 seconds 00000001:00000004:0.0:1783947768.024984:0:23393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1783947768.025604:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203264 00000100:00100000:3.0:1783947768.025616:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203264 00000100:00100000:3.0:1783947768.025667:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947768.025679:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1870604236203264:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783947768.026656:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1870604236203264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 972us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947768.026668:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947768.030965:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1870604236203264:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1783947768.031063:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947768.033314:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783947768.033397:0:23420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783947768.033402:0:23420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1783947768.040971:0:23393:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783947768.041013:0:23393:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb79481687988 00100000:10000000:3.0:1783947768.041022:0:23393:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783947768.042374:0:23393:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947768.042402:0:23393:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947768.042422:0:23393:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783947768.042447:0:23393:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783947768.043837:0:23393:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947768.044231:0:23393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783947768.053777:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783947768.778606:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947769.013992:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947769.075830:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 10000000:01000000:0.0:1783947769.332855:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783947769.332876:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be7b4d000 from 12 10000000:01000000:0.0:1783947769.332883:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783947769.332943:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947769.332958:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947769.332972:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947769.333009:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947769.333101:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947769.333154:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947769.333693:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203392 00000100:00100000:1.0:1783947769.333705:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203392 00000100:00100000:1.0:1783947769.333778:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947769.333790:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:22658:x1870604236203392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947769.333810:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947769.333831:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d5b expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947769.333862:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947769.333883:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947769.333894:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438c00, rc 0) 00000100:00100000:1.0:1783947769.333971:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236203392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947769.333978:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783947769.334357:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947769.334380:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947769.334392:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947769.334510:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783947769.334572:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947769.334616:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947769.334852:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203520 00000100:00100000:3.0:1783947769.334859:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203520 00000100:00100000:3.0:1783947769.334912:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947769.334922:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236203520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783947769.334945:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783947769.334967:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783947769.334971:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1783947769.335076:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236203520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947769.335093:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947769.335138:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783947769.335200:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947769.335210:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947769.335220:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947769.335233:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947769.335236:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bf7a56000 from 12 10000000:01000000:3.0:1783947769.335240:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947769.335269:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947769.335278:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947769.335289:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947769.335306:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947769.335339:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947769.335360:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be4424240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947769.335375:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203648 00000100:00100000:3.0:1783947769.335379:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203648 00000100:00100000:3.0:1783947769.335407:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947769.335414:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236203648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947769.335431:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947769.335443:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d69 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947769.335492:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947769.335505:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947769.335514:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ae00, rc 0) 00000100:00100000:1.0:1783947769.335598:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947769.335623:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947769.335633:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947769.335694:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783947769.335731:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947769.335757:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc318c300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947769.335769:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203776 00000100:00100000:1.0:1783947769.335773:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203776 00000100:00100000:1.0:1783947769.335793:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947769.335800:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:22658:x1870604236203776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783947769.335813:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947769.335826:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947769.335830:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1783947769.335903:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:22658:x1870604236203776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947769.335918:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947769.335959:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236203776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783947769.336013:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947769.336020:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947769.336027:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947769.336740:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:22658:x1870604236203648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947769.336749:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:1.0:1783947769.780074:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947770.039604:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947770.099738:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783947770.805866:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947771.127617:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783947771.827964:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947772.147629:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000001:02000400:3.0:1783947772.800824:0:23663:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783947772.854160:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947773.173308:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 0 seconds 00000100:00080000:0.0:1783947773.175158:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783947773.175166:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783947773.175170:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947773.175183:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7bc48d6800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947773.175216:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a14700 x1870604236204160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947773.175236:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947773.175240:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947773.175243:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947773.175246:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947773.175276:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947773.175280:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947773.175283:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947773.175286:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947773.177221:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236203904:0@lo:400:kworker.0 00000100:00100000:0.0:1783947773.177298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947773.177345:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236204544:0@lo:400:kworker.0 00000100:00100000:0.0:1783947773.177372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947773.183259:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236204032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947773.183352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947773.184091:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204544 00000100:00100000:3.0:1783947773.184100:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204544 00000100:00100000:3.0:1783947773.184152:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947773.184161:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236204544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947773.184219:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236204544:12345-0@lo:400:kworker.0 Request processed in 60us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947773.184226:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947773.184248:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236203904 00000100:00100000:3.0:1783947773.184252:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236203904 00000100:00100000:3.0:1783947773.184273:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783947773.184285:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:3637:x1870604236203904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947773.184312:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:3637:x1870604236203904:12345-0@lo:400:kworker.0 Request processed in 28us (7015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947773.184318:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783947773.184356:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236204416:0@lo:400:kworker.0 00000100:00100000:3.0:1783947773.184378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947773.184398:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947773.184404:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236204288:0@lo:400:kworker.0 00000100:00100000:3.0:1783947773.184421:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947773.184446:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236204160:0@lo:38:kworker.0 00000100:00100000:3.0:1783947773.184480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947773.184518:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204032 00000100:00100000:3.0:1783947773.184521:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204032 00000100:00100000:3.0:1783947773.184536:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204416 00000100:00100000:3.0:1783947773.184538:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204416 00000100:00100000:3.0:1783947773.184545:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204160 00000100:00100000:3.0:1783947773.184547:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204160 00000100:00100000:3.0:1783947773.184555:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947773.184560:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236204032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947773.184584:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947773.184616:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236204032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947773.184622:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947773.184632:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947773.184636:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236204416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947773.184659:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236204416:12345-0@lo:400:kworker.0 Request processed in 22us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947773.184670:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947773.184693:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947773.184697:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236204160:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783947773.184719:0:22666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:3.0:1783947773.184750:0:22666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501d77 00000004:00100000:3.0:1783947773.184763:0:22666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783947773.184770:0:22666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1783947773.184859:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236204032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947773.184892:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236204416:0@lo:400:kworker.0 00000100:00100000:0.0:1783947773.185718:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204288 00000100:00100000:0.0:1783947773.185726:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204288 00000100:00100000:0.0:1783947773.185760:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947773.185766:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947773.185835:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236204288:12345-0@lo:400:kworker.0 Request processed in 69us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947773.185841:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783947773.186059:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bf7a16300 x1870604236204288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947773.186073:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236204288:0@lo:400:kworker.0 00000100:00100000:0.0:1783947773.186100:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236203904:0@lo:400:kworker.0 00010000:00080000:0.0:1783947773.186112:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bf7a14a80 x1870604236204544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947773.186121:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236204544:0@lo:400:kworker.0 00000100:00080000:0.0:1783947773.222349:0:22666:0:(import.c:65:import_set_state_nolock()) ffff9e7bff95b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947773.222450:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236204160:12345-0@lo:38:kworker.0 Request processed in 37750us (37968us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947773.222497:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783947773.222641:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783947773.222651:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783947773.222657:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783947773.222660:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1783947773.222677:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b3b4b4ef): req@ffff9e7bd9353b80 x1870604236197120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947773.222693:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236204160:0@lo:38:kworker.0 00000100:00100000:0.0:1783947773.222806:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947773.222828:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947773.222844:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236197120 00000100:00100000:0.0:1783947773.222850:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236197120 00000100:00100000:2.0:1783947773.223094:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236204672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947773.223121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947773.226238:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204672 00000100:00100000:0.0:1783947773.226249:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204672 00000100:00100000:0.0:1783947773.226290:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947773.226298:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22703:x1870604236197120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783947773.226410:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22703:x1870604236197120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 112us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947773.226418:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947773.226443:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947773.226448:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236204672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947773.226841:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783947773.227168:0:22703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22703:1870604236197120:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783947773.227206:0:22703:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783947773.227252:0:22703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22703:1870604236204800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783947773.227294:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947773.227316:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc318c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947773.228007:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236204672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1554us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947773.228018:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947773.228039:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204800 00000100:00100000:0.0:1783947773.228057:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204800 00000100:00100000:0.0:1783947773.228085:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947773.228094:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22703:x1870604236204800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783947773.228216:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22703:x1870604236204800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 123us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947773.228223:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947773.228255:0:22703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22703:1870604236204800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783947773.228343:0:22703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22703:1870604236204928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783947773.228374:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947773.228391:0:22703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a62e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947773.228403:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236204928 00000100:00100000:0.0:1783947773.228406:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236204928 00000100:00100000:0.0:1783947773.228423:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947773.228429:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22703:x1870604236204928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783947773.228510:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22703:x1870604236204928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947773.228517:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947773.228540:0:22703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22703:1870604236204928:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783947773.228588:0:22703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947773.232767:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236204672:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783947773.233426:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783947773.233520:0:22703:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1783947773.233525:0:22703:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1783947773.850108:0:23715:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947773.850722:0:23715:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947773.879214:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947774.900631:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783947774.912743:0:23766:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947774.913106:0:23766:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947775.927224:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783947776.082361:0:23814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd922aadc0 20000000:00000080:0.0:1783947776.082379:0:23814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7ac1729800 uarg=0000000000000000 20000000:01000000:0.0:1783947776.082424:0:23814:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783947776.082442:0:23814:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783947776.082447:0:23814:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783947776.083318:0:23815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1783947776.083492:0:23814:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783947776.096503:0:23814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783947776.098225:0:23814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.098248:0:23814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.098256:0:23814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.098275:0:23814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.098318:0:23814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.098335:0:23814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 17 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947776.098351:0:23814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1870604236205056:0@lo:104: 00000100:00100000:3.0:1783947776.098447:0:23814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947776.098525:0:23814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.098534:0:23814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 17 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947776.098542:0:23814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1870604236205184:0@lo:104: 00000100:00100000:3.0:1783947776.098562:0:23814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947776.098580:0:23814:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947776.098675:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205056 00000100:00100000:1.0:1783947776.098683:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205056 00000100:00100000:1.0:1783947776.098727:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205184 00000100:00100000:1.0:1783947776.098729:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205184 00000100:00100000:1.0:1783947776.098742:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947776.098750:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:23814:x1870604236205056:12345-0@lo:104: 00010000:00010000:1.0:1783947776.098765:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.098834:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947776.098840:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:23814:x1870604236205056:12345-0@lo:104: Request processed in 91us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947776.098847:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947776.098867:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947776.098873:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:23814:x1870604236205184:12345-0@lo:104: 00010000:00010000:1.0:1783947776.098880:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.098925:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947776.098930:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:23814:x1870604236205184:12345-0@lo:104: Request processed in 58us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947776.098936:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783947776.098954:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947776.098960:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.098966:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947776.098970:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.098989:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947776.098997:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947776.099003:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947776.099174:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099181:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947776.099204:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099211:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439400/0xe6fd1fdb55501d23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d2a expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099226:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947776.099229:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099234:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947776.099237:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099244:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947776.099250:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947776.099255:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947776.099268:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099272:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947776.099277:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099293:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b400/0xe6fd1fdb55501c20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501c27 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099307:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947776.099308:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947776.099309:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947776.099329:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236205312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947776.099362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947776.099385:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947776.099390:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236205440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947776.099410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947776.099449:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205312 00000100:00100000:1.0:1783947776.099478:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205312 00010000:00010000:1.0:1783947776.099501:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 18 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947776.099524:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205440 00000100:00100000:1.0:1783947776.099527:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205440 00010000:00010000:1.0:1783947776.099537:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 19 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947776.099548:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947776.099553:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:3639:x1870604236205312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947776.099562:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947776.099567:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 19 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099577:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 19 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099597:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947776.099624:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:3639:x1870604236205312:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947776.099630:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947776.099642:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947776.099648:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:3639:x1870604236205440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947776.099655:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947776.099659:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 18 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099668:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 18 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099678:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099686:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099698:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099706:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099713:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099719:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099730:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947776.099734:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099741:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099749:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947776.099757:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947776.099780:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:3639:x1870604236205440:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947776.099786:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947776.099822:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236205440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947776.099830:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236205312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947776.100247:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501d23 expref: 17 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947776.100261:0:23814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1870604236205056:0@lo:104: 00010000:00010000:3.0:1783947776.100270:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501c27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501c20 expref: 16 pid: 22654 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947776.100280:0:23814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1870604236205184:0@lo:104: 00010000:00010000:3.0:1783947776.100308:0:23814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.100318:0:23814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.100325:0:23814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947776.100332:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501d7e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947776.101249:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947776.245752:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947776.948027:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947777.278086:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947767/real 1783947767] req@ffff9e7bf7a17800 x1870604236200320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947777.278130:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf7a17800 x1870604236200320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947777.278143:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947767/real 1783947767] req@ffff9e7bf7a16d80 x1870604236200192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947777.278157:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf7a16d80 x1870604236200192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947777.278183:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947777.278213:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947777.278218:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236200320:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783947777.278225:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947777.278231:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947777.278243:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236200192:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783947777.278833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947777.278838:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947777.278842:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947777.278852:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947777.278891:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947777.278894:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783947777.278898:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947777.278904:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:2.0:1783947777.278911:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783947777.278919:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7bf34ca000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947777.278945:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3485180 x1870604236206080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947777.278961:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947777.278964:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783947777.278966:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947777.278970:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:2.0:1783947777.278973:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783947777.278976:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947777.278989:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf3485c00 x1870604236206208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947777.279030:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236205696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947777.279117:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947777.279163:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783947777.279170:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236205568:0@lo:400:kworker.0 00000100:00100000:2.0:1783947777.279206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947777.279237:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236206336:0@lo:400:kworker.0 00000100:00100000:2.0:1783947777.279265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947777.279305:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236205824:0@lo:400:kworker.0 00000100:00100000:2.0:1783947777.279334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947777.279355:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947777.279361:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236205952:0@lo:400:kworker.0 00000100:00100000:2.0:1783947777.279386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947777.279510:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205696 00000100:00100000:3.0:1783947777.279521:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205696 00000100:00100000:3.0:1783947777.279575:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205952 00000100:00100000:3.0:1783947777.279579:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205952 00000100:00100000:3.0:1783947777.279597:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947777.279608:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236205696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947777.279680:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236205696:12345-0@lo:400:kworker.0 Request processed in 73us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.279688:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947777.279706:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947777.279712:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236205952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947777.279743:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236205952:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.279749:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947777.279818:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205568 00000100:00100000:3.0:1783947777.279822:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205568 00000100:00100000:3.0:1783947777.279850:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783947777.279857:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:3638:x1870604236205568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947777.279899:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:3638:x1870604236205568:12345-0@lo:400:kworker.0 Request processed in 32us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.279906:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783947777.279952:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236206080:0@lo:8:kworker.0 00000400:00000100:3.0:1783947777.279981:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236206080 offset 0 length 520: 4 00000100:00100000:3.0:1783947777.279996:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236206208:0@lo:8:kworker.0 00000400:00000100:3.0:1783947777.280016:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236206208 offset 0 length 520: 4 00000100:00100000:3.0:1783947777.280061:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236206336 00000100:00100000:3.0:1783947777.280064:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236206336 00000100:00100000:3.0:1783947777.280088:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236205824 00000100:00100000:3.0:1783947777.280091:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236205824 00000100:00100000:3.0:1783947777.280104:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947777.280109:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236206336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947777.280141:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236206336:12345-0@lo:400:kworker.0 Request processed in 32us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.280147:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947777.280158:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947777.280163:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947777.280187:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236205824:12345-0@lo:400:kworker.0 Request processed in 24us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.280193:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947777.280243:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236205568:0@lo:400:kworker.0 00010000:00080000:3.0:1783947777.280263:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bf3486d80 x1870604236206336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947777.280275:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236206336:0@lo:400:kworker.0 00000100:00100000:3.0:1783947777.280286:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236205696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947777.280946:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236205952:0@lo:400:kworker.0 00010000:00080000:2.0:1783947777.280962:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bf3486680 x1870604236205824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947777.280971:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236205824:0@lo:400:kworker.0 10000000:01000000:1.0:1783947777.843641:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947777.843656:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be7b4d000 from 13 10000000:01000000:1.0:1783947777.843665:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947777.843754:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947777.843767:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947777.843781:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947777.843840:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947777.843941:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947777.844010:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc318c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947777.844689:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236206464 00000100:00100000:0.0:1783947777.844701:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236206464 00000100:00100000:0.0:1783947777.844774:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947777.844785:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+16:22658:x1870604236206464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947777.844806:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947777.844827:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d85 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947777.844861:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947777.844873:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947777.844883:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96000, rc 0) 00000100:00100000:0.0:1783947777.844949:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236206464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947777.844968:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783947777.845932:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947777.845978:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947777.845992:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947777.846127:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947777.846192:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947777.846281:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc318c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947777.859906:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236206592 00000100:00100000:3.0:1783947777.859933:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236206592 00000100:00100000:3.0:1783947777.860030:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947777.860045:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236206592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947777.860327:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236206592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (14134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.860356:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947777.860410:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947777.860546:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947777.860636:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947777.860682:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a62840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947777.862719:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236206720 00000100:00100000:3.0:1783947777.862739:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236206720 00000100:00100000:3.0:1783947777.862815:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783947777.862840:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236206720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947777.863095:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236206720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.863103:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783947777.863357:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947777.864511:0:23881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783947777.869412:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783947777.870326:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947777.870350:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947777.870366:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947777.870490:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947777.870495:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bf7a56000 from 13 10000000:01000000:0.0:1783947777.870498:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947777.870556:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947777.870565:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947777.870594:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947777.870632:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947777.870740:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947777.870806:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a62900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947777.871216:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236206848 00000100:00100000:3.0:1783947777.871228:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236206848 00000100:00100000:3.0:1783947777.871302:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947777.871315:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+17:22658:x1870604236206848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947777.871337:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947777.871356:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501d93 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947777.871389:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947777.871413:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947777.871423:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:3.0:1783947777.871511:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:22658:x1870604236206848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947777.871520:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947777.871540:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947777.871558:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947777.871638:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947777.871739:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947777.871773:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947777.871811:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc318c180 going to sleep for 11 seconds 00000100:00100000:0.0:1783947777.872327:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236206976 00000100:00100000:0.0:1783947777.872335:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236206976 00000100:00100000:0.0:1783947777.872388:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947777.872408:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:22658:x1870604236206976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947777.873359:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:22658:x1870604236206976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 958us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947777.873371:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947777.873514:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236206976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947777.873679:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236207104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947777.873734:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947777.873773:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc318c180 going to sleep for 11 seconds 00000100:00100000:0.0:1783947777.873830:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236207104 00000100:00100000:0.0:1783947777.873836:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236207104 00000100:00100000:0.0:1783947777.873884:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947777.873894:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:22658:x1870604236207104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947777.874001:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:22658:x1870604236207104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947777.874009:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947777.874180:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236207104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947777.878116:0:23883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783947777.878754:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783947777.878792:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947777.878819:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947777.878836:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947777.974865:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947778.293038:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947763/real 1783947763] req@ffff9e7bf3485500 x1870604236198400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947778 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947778.293084:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf3485500 x1870604236198400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947778 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947778.293096:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947763/real 1783947763] req@ffff9e7bf3484000 x1870604236198144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947778 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947778.293108:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf3484000 x1870604236198144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947778 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947778.293132:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947778.293150:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947778.293156:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236198400:0@lo:8:kworker.0 00000100:00080000:3.0:1783947778.293162:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947778.293167:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947778.293170:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236198144:0@lo:8:kworker.0 00000100:00100000:3.0:1783947778.293208:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236207232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947778.293291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947778.293344:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236207360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947778.293371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947778.293427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947778.293434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783947778.293437:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947778.293443:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:3.0:1783947778.293451:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783947778.293490:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bc48d2000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947778.293527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9352300 x1870604236207488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947778.293544:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947778.293547:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947778.293549:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947778.293552:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:3.0:1783947778.293555:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783947778.293559:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947778.293572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9352d80 x1870604236207616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947778.293593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947778.293596:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947778.293600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947778.293603:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947778.293639:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236207232 00000100:00100000:3.0:1783947778.293648:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236207232 00000100:00100000:3.0:1783947778.293704:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236207360 00000100:00100000:3.0:1783947778.293707:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236207360 00000100:00100000:3.0:1783947778.293725:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947778.293735:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236207232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947778.293785:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947778.293835:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236207232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947778.293843:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947778.293862:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947778.293876:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236207360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947778.293895:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947778.293924:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236207360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947778.293930:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947778.293955:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236207872:0@lo:400:kworker.0 00000100:00100000:3.0:1783947778.293988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947778.294021:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236207872 00000100:00100000:3.0:1783947778.294025:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236207872 00000100:00100000:3.0:1783947778.294053:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947778.294060:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236207872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947778.294099:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236207872:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947778.294108:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947778.294147:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236207744:0@lo:400:kworker.0 00000100:00100000:3.0:1783947778.294181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947778.294212:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236207744 00000100:00100000:3.0:1783947778.294216:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236207744 00000100:00100000:3.0:1783947778.294239:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947778.294245:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236207744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947778.294280:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236207744:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947778.294286:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783947778.294319:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bd9353800 x1870604236207872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947778.294335:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236207872:0@lo:400:kworker.0 00010000:00080000:3.0:1783947778.294374:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bd9350380 x1870604236207744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947778.294396:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236207744:0@lo:400:kworker.0 00000100:00100000:3.0:1783947778.294426:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236207360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947778.294483:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236207232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947778.294504:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236207488:0@lo:8:kworker.0 00000400:00000100:3.0:1783947778.294527:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236207488 offset 0 length 520: 4 00000100:00100000:3.0:1783947778.294555:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236207616:0@lo:8:kworker.0 00000400:00000100:3.0:1783947778.294572:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236207616 offset 0 length 520: 4 00000001:00100000:2.0:1783947778.817563:0:23394:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783947778.998310:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947780.024400:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947780.280631:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947781.048499:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947782.069308:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947783.104819:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783947783.136324:0:24163:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783947783.136328:0:24163:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783947783.136330:0:24163:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783947783.136444:0:24163:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7bfb129000 00000020:01000004:2.0:1783947783.136494:0:24163:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783947783.136507:0:24163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783947783.136522:0:24163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e7ac66f4d40) 00000020:00000080:2.0:1783947783.136540:0:24163:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783947783.210233:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783947783.220304:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783947783.220556:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783947783.220825:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783947783.228024:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783947783.228725:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783947783.229067:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1783947783.238221:0:24163:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783947783.238515:0:24163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783947783.238530:0:24163:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783947783.238543:0:24163:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6fd1fdb55501da8 00000020:01000004:0.0:1783947783.238551:0:24163:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783947783.238576:0:24163:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783947783.238580:0:24163:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783947783.238586:0:24163:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783947783.238591:0:24163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783947783.238602:0:24163:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e7c01b8cd40) 00000020:00000080:0.0:1783947783.238613:0:24163:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1783947783.240108:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947783.240268:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783947783.240280:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783947783.244408:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947783.244423:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783947783.251704:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783947783.251716:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783947783.253143:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947783.253341:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783947783.253348:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783947783.254259:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783947783.254268:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783947783.277693:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947783.277940:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947783.277947:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783947783.284619:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947783.284636:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783947783.286151:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947783.286169:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783947783.295524:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947783.296007:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783947783.296016:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783947783.300588:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783947783.300604:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783947783.338356:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947783.338624:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783947783.338632:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783947783.339715:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783947783.339727:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783947783.340202:0:24163:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783947783.340234:0:24163:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783947783.340240:0:24163:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783947783.351431:0:24163:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947783.351924:0:24163:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783947783.351930:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947783.351932:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947783.351933:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947783.351934:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947783.351935:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947783.351936:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947783.351938:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947783.351940:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947783.351941:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947783.351945:0:24163:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783947783.351947:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947783.351948:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947783.351949:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947783.351950:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947783.351951:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947783.351952:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947783.351953:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947783.351954:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947783.351956:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947783.351989:0:24163:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783947783.352014:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783947783.352094:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947783.352151:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5dc4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.352216:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208000 00000100:00100000:0.0:1783947783.352226:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208000 00000100:00100000:0.0:1783947783.352297:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947783.352310:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:24163:x1870604236208000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947783.352355:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783947783.352359:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783947783.352362:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783947783.352702:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:24163:x1870604236208000:12345-0@lo:253:mount.lustre.0 Request processed in 396us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.352711:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947783.352794:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947783.352804:0:24163:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783947783.352806:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947783.352807:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947783.352809:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947783.352810:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947783.352811:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947783.352812:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947783.352818:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947783.352819:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947783.352821:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947783.352851:0:24163:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bfb129000 from lustre-OST0000 10000000:01000000:1.0:1783947783.352875:0:24163:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783947783.352877:0:24163:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783947783.352884:0:24163:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7bc47bb380 local copy 00010000:00010000:1.0:1783947783.352893:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947783.352970:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947783.352998:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947783.353029:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a1a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.353126:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208128 00000100:00100000:3.0:1783947783.353130:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208128 00000100:00100000:3.0:1783947783.353162:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783947783.353168:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:24163:x1870604236208128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947783.353235:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:24163:x1870604236208128:12345-0@lo:501:mount.lustre.0 Request processed in 67us (236us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947783.353242:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947783.353314:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208128:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783947783.353329:0:24163:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783947783.353350:0:24163:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783947783.353356:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.353365:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947783.353386:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bfb129000 10000000:01000000:0.0:1783947783.353390:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947783.353394:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783947783.353397:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947783.353401:0:24163:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783947783.353404:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783947783.353423:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.353431:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.353440:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947783.353450:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947783.353504:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.353525:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c12240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947783.353568:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208256 00000100:00100000:1.0:1783947783.353572:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208256 00000100:00100000:1.0:1783947783.353602:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783947783.353608:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+18:24163:x1870604236208256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947783.353617:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947783.353628:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb55501dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501db6 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947783.353647:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb55501dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501db6 expref: 19 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947783.353658:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb55501dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501db6 expref: 19 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947783.353665:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438200, rc 0) 00000100:00100000:1.0:1783947783.353689:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208256:12345-0@lo:101:mount.lustre.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947783.353703:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783947783.353875:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947783.353887:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501dbd expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947783.353906:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501dbd expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947783.354847:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1783947783.355386:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947783.358582:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783947783.358644:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783947783.358659:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783947783.358673:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783947783.358704:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783947783.358721:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783947783.358735:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783947783.358747:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783947783.358759:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1783947783.358784:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1783947783.358800:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1783947783.358812:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1783947783.358842:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1783947783.358847:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1783947783.362936:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947783.363011:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947783.363119:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947783.364727:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208384 00000100:00100000:1.0:1783947783.364739:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208384 00000100:00100000:1.0:1783947783.364801:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783947783.364811:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947783.365201:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208384:12345-0@lo:501:mount.lustre.0 Request processed in 390us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947783.365210:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783947783.365335:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947783.365448:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947783.365526:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947783.365561:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cb300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.365783:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208512 00000100:00100000:0.0:1783947783.365788:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208512 00000100:00100000:0.0:1783947783.365833:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783947783.365839:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947783.366649:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208512:12345-0@lo:503:mount.lustre.0 Request processed in 807us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.366658:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947783.367212:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947783.367814:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947783.367899:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947783.367957:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947783.368651:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208640 00000100:00100000:1.0:1783947783.368661:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208640 00000100:00100000:1.0:1783947783.368723:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783947783.368733:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947783.369129:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947783.372068:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208640:12345-0@lo:502:mount.lustre.0 Request processed in 3324us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947783.372085:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947783.372329:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947783.372636:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783947783.372668:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783947783.372701:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783947783.372731:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783947783.372745:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783947783.372757:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783947783.372769:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783947783.372781:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783947783.372793:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1783947783.372804:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1783947783.372815:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1783947783.372825:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1783947783.372866:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947783.372922:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947783.372958:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.374432:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208768 00000100:00100000:0.0:1783947783.374446:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208768 00000100:00100000:0.0:1783947783.374552:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783947783.374563:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947783.374736:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208768:12345-0@lo:502:mount.lustre.0 Request processed in 175us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.374743:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947783.375195:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947783.375278:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1783947783.375302:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1783947783.378914:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947783.378926:0:24180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783947783.378934:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947783.378937:0:24180:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783947783.378944:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947783.378960:0:24180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e7c01b88000) 00000020:00000080:0.0:1783947783.378988:0:24180:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783947783.378996:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783947783.379096:0:24180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bfb129000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783947783.379107:0:24180:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783947783.379117:0:24180:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6fd1fdb55501dcb 00010000:00010000:0.0:1783947783.390106:0:24180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1783947783.390842:0:24180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1783947783.395306:0:24180:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1783947783.401351:0:24180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783947783.401369:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.401376:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.401379:0:24180:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783947783.401382:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783947783.401386:0:24180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1783947783.401388:0:24180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783947783.401389:0:24180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783947783.401391:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783947783.401393:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.401395:0:24180:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783947783.401397:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947783.401400:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.401402:0:24180:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783947783.401414:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783947783.401417:0:24180:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783947783.401419:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.401421:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.401423:0:24180:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783947783.401425:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947783.401428:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.401429:0:24180:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783947783.401433:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783947783.401498:0:24180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.401502:0:24180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.401504:0:24180:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783947783.401507:0:24180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1783947783.401680:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783947783.401740:0:24163:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783947783.401764:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501dbd expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947783.401796:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50600/0xe6fd1fdb55501db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501dbd expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947783.401804:0:24163:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bfb129000 from 1 10000000:01000000:2.0:1783947783.401807:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947783.401845:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947783.401851:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947783.401861:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947783.401886:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947783.401963:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947783.402005:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947783.402188:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236208896 00000100:00100000:1.0:1783947783.402195:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236208896 00000100:00100000:1.0:1783947783.402247:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783947783.402257:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:24163:x1870604236208896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947783.402272:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947783.402298:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501dd2 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947783.402324:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947783.402334:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947783.402342:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439c00, rc 0) 00000100:00100000:1.0:1783947783.402383:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236208896:12345-0@lo:101:mount.lustre.0 Request processed in 127us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947783.402390:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947783.403000:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236208896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947783.403019:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947783.403029:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783947783.404675:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1783947783.405264:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947783.412012:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236209024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947783.412088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947783.412123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.412128:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947783.412131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.412144:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947783.412162:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236209408:0@lo:400:kworker.0 00000100:00080000:2.0:1783947783.412171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.412178:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947783.412181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.412185:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947783.412213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.412237:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947783.412244:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236209536:0@lo:400:kworker.0 00000100:00100000:3.0:1783947783.412268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.412317:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236209152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947783.412326:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209024 00000100:00100000:0.0:1783947783.412335:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209024 00000100:00100000:3.0:1783947783.412356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.412371:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236209664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.412379:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209536 00000100:00100000:0.0:1783947783.412383:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209536 00000100:00100000:3.0:1783947783.412396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.412400:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209152 00000100:00100000:0.0:1783947783.412411:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209152 00000100:00100000:3.0:1783947783.412417:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947783.412424:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236209280:0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.412436:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947783.412447:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236209024:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947783.412448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.412504:0:22666:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783947783.412513:0:22666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:0.0:1783947783.412528:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947783.412539:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209408 00000100:00100000:3.0:1783947783.412544:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209408 00000100:00100000:3.0:1783947783.412569:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209664 00000100:00100000:3.0:1783947783.412572:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209664 00000100:00100000:3.0:1783947783.412603:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947783.412622:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236209408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947783.412668:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236209408:12345-0@lo:400:kworker.0 Request processed in 58us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.412676:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947783.412696:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947783.412702:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236209664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.412729:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236209024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 284us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.412742:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947783.412755:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236209664:12345-0@lo:400:kworker.0 Request processed in 52us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.412760:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209280 00000100:00100000:3.0:1783947783.412765:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947783.412766:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209280 00000100:00100000:0.0:1783947783.412786:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947783.412795:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1870604236209536:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783947783.412821:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac8623100 x1870604236209408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947783.412833:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1870604236209536:12345-0@lo:400:kworker.0 Request processed in 37us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.412840:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236209408:0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.412845:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947783.412868:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236209536:0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.412868:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947783.412880:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236209152:12345-0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1783947783.412898:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac8621500 x1870604236209664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1783947783.412900:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947783.412914:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236209664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.412949:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236209152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (592us total) trans 0 rc 0/0 00000040:00080000:3.0:1783947783.413056:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1783947783.413110:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1783947783.413127:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1783947783.413143:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000100:00100000:0.0:1783947783.413143:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000040:00080000:3.0:1783947783.413163:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000100:00100000:0.0:1783947783.413164:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947783.413175:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236209280:12345-0@lo:400:kworker.0 00000040:00080000:3.0:1783947783.413189:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1783947783.413209:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000100:00100000:0.0:1783947783.413214:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236209280:12345-0@lo:400:kworker.0 Request processed in 41us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.413222:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:3.0:1783947783.413227:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1783947783.413251:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000100:00100000:0.0:1783947783.413261:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236209024:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783947783.413271:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1783947783.413312:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000100:00100000:0.0:1783947783.413318:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236209280:0@lo:400:kworker.0 00000100:00100000:0.0:1783947783.413336:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236209152:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1783947783.413346:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1783947783.413354:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1783947783.413492:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236209792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947783.413531:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.413559:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209792 00000100:00100000:3.0:1783947783.413563:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209792 00000100:00100000:3.0:1783947783.413599:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947783.413606:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236209792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947783.413707:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236209792:12345-0@lo:501:mount.lustre.0 Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.413721:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947783.413767:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be78313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.413781:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236209792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947783.413812:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236209920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947783.413852:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.413873:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be78313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.413897:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236209920 00000100:00100000:0.0:1783947783.413902:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236209920 00000100:00100000:0.0:1783947783.413940:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947783.413949:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236209920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947783.414215:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236209920:12345-0@lo:503:mount.lustre.0 Request processed in 268us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.414223:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783947783.414798:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236209920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783947783.417559:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947783.417683:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947783.419235:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.419303:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be78313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.419335:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210048 00000100:00100000:0.0:1783947783.419345:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210048 00000100:00100000:0.0:1783947783.419404:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947783.419414:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236210048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947783.420173:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236210048:12345-0@lo:502:mount.lustre.0 Request processed in 755us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.420185:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947783.420523:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947783.420864:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783947783.420899:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1783947783.420912:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1783947783.420926:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1783947783.420938:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1783947783.420951:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1783947783.420995:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1783947783.421013:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1783947783.421026:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1783947783.421039:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1783947783.421052:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1783947783.421092:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947783.421155:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.421195:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.421326:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210176 00000100:00100000:3.0:1783947783.421333:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210176 00000100:00100000:3.0:1783947783.421381:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783947783.421391:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236210176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947783.421530:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236210176:12345-0@lo:502:mount.lustre.0 Request processed in 140us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.421537:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783947783.421751:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947783.421812:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1783947783.421821:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783947783.426616:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947783.426630:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426633:0:24185:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783947783.426641:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bfb129000 00000020:00000080:1.0:1783947783.426643:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947783.426652:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.426655:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426656:0:24185:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783947783.426658:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947783.426660:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426661:0:24185:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783947783.426664:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bfb129000 00000020:00000080:1.0:1783947783.426666:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947783.426726:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.426730:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426731:0:24185:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783947783.426733:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947783.426736:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426737:0:24185:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783947783.426740:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bfb129000 00000020:00000080:1.0:1783947783.426742:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947783.426761:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.426765:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426766:0:24185:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783947783.426768:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947783.426771:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426772:0:24185:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783947783.426775:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bfb129000 00000020:00000080:1.0:1783947783.426777:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947783.426797:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947783.426801:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947783.426802:0:24185:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783947783.426805:0:24185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1783947783.426876:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783947783.426911:0:24163:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947783.426936:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.426949:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947783.427011:0:24163:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783947783.427014:0:24163:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bfb129000 10000000:01000000:0.0:1783947783.427017:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bfb129000 10000000:01000000:0.0:1783947783.427021:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947783.427027:0:24163:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bfb129000 from 1 10000000:01000000:0.0:1783947783.427030:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947783.427077:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.427084:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.427097:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947783.427127:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947783.427228:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.427271:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.427323:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210304 00000100:00100000:3.0:1783947783.427331:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210304 00000100:00100000:3.0:1783947783.427387:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783947783.427396:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:24163:x1870604236210304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947783.427421:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947783.427434:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501de0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.427482:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501de0 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.427495:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846a800/0xe6fd1fdb55501de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501de0 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.427504:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a800, rc 0) 00000100:00100000:3.0:1783947783.427556:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210304:12345-0@lo:101:mount.lustre.0 Request processed in 161us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.427564:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783947783.427649:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947783.427664:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501de7 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.427673:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501de7 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783947783.436500:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1783947783.436822:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947783.441833:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783947783.441902:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1783947783.441918:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1783947783.441931:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1783947783.441944:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1783947783.441957:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1783947783.441969:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1783947783.441981:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1783947783.441992:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783947783.442003:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1783947783.442015:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1783947783.442027:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1783947783.442039:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1783947783.442051:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1783947783.442074:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1783947783.442087:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1783947783.442099:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1783947783.442124:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1783947783.442139:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1783947783.442154:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1783947783.442166:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1783947783.442180:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1783947783.442194:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1783947783.442208:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1783947783.442222:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1783947783.442235:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1783947783.442247:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1783947783.442257:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1783947783.442269:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1783947783.442281:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1783947783.442310:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1783947783.442323:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1783947783.442336:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1783947783.442360:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1783947783.442375:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1783947783.442387:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1783947783.442398:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1783947783.442410:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1783947783.442422:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1783947783.442433:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1783947783.442445:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1783947783.442482:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1783947783.442496:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1783947783.442507:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1783947783.442517:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1783947783.442527:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1783947783.442538:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1783947783.442558:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1783947783.442674:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1783947783.442692:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1783947783.442711:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1783947783.442717:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1783947783.442830:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947783.442901:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.442955:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947783.443518:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210432 00000100:00100000:2.0:1783947783.443529:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210432 00000100:00100000:2.0:1783947783.443581:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947783.443591:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947783.443734:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210432:12345-0@lo:501:mount.lustre.0 Request processed in 143us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947783.443741:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947783.444070:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947783.444120:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947783.444159:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947783.444191:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.444237:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210560 00000100:00100000:3.0:1783947783.444242:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210560 00000100:00100000:3.0:1783947783.444272:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783947783.444279:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947783.444365:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210560:12345-0@lo:503:mount.lustre.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.444371:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947783.444471:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783947783.446209:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947783.446306:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947783.446373:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947783.446409:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc94516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.446578:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210688 00000100:00100000:3.0:1783947783.446586:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210688 00000100:00100000:3.0:1783947783.446630:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783947783.446638:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947783.446747:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210688:12345-0@lo:502:mount.lustre.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.446754:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783947783.446890:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947783.448531:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783947783.448566:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783947783.448582:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783947783.448595:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783947783.448621:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783947783.448636:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783947783.448650:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783947783.448664:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783947783.448678:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783947783.448692:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783947783.448707:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783947783.448720:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783947783.448734:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783947783.448766:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783947783.451119:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783947783.451136:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783947783.451149:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783947783.451161:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783947783.451172:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783947783.451184:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783947783.451196:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783947783.451207:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783947783.451219:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783947783.451232:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783947783.451246:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1783947783.451258:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1783947783.451270:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1783947783.451282:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1783947783.451311:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1783947783.451343:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1783947783.451357:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1783947783.451369:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1783947783.451381:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1783947783.451393:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1783947783.451405:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1783947783.451419:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1783947783.451434:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1783947783.451478:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1783947783.451496:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1783947783.451510:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1783947783.451524:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1783947783.451538:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1783947783.451553:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1783947783.451567:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1783947783.451581:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1783947783.451609:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1783947783.451626:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1783947783.451640:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1783947783.451698:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947783.454715:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.454772:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210816 00000100:00100000:0.0:1783947783.454781:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210816 00000100:00100000:0.0:1783947783.454834:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783947783.454844:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947783.454994:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210816:12345-0@lo:502:mount.lustre.0 Request processed in 152us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.455003:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783947783.455324:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.455352:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947783.455634:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1783947783.455668:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1783947783.455723:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947783.455765:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.455794:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947783.456885:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236210944 00000100:00100000:3.0:1783947783.456895:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236210944 00000100:00100000:3.0:1783947783.456945:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783947783.456955:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947783.457107:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236210944:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.457116:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783947783.457796:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236210944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947783.457890:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1783947783.457904:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783947783.462960:0:24191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783947783.462994:0:24191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e7bc55119c0) 00000020:00000080:3.0:1783947783.463021:0:24191:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783947783.463239:0:24191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bfb129000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947783.463244:0:24191:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bfb129000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947783.463246:0:24191:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bfb129000 3 00010000:00080000:3.0:1783947783.463277:0:24191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac7c0a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947783.464818:0:24191:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783947783.464914:0:24191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783947783.464952:0:24191:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947783.464962:0:24191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe6fd1fdb55501df5 00000100:00080000:3.0:1783947783.464971:0:24191:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947783.464977:0:24191:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7ac7c0a800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947783.465012:0:24191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9353800 x1870604236211072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947783.465060:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236211072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783947783.465126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.465183:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211072 00000100:00100000:3.0:1783947783.465189:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211072 00000100:00100000:3.0:1783947783.465218:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947783.465225:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236211072:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783947783.465249:0:22663:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:3.0:1783947783.465303:0:22663:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe6fd1fdb55501dfc 00000004:00100000:3.0:1783947783.465320:0:22663:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947783.465350:0:22663:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7c0e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947783.465402:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870604236211072:12345-0@lo:38:llog_process_th.0 Request processed in 176us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.465409:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783947783.465449:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bd9353800 x1870604236211072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947783.465476:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947783.465484:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1783947783.465492:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783947783.465499:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783947783.465502:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7c0a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783947783.465509:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236211072:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783947783.465531:0:24191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783947783.465925:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.465931:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947783.465934:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.465937:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947783.465941:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.465944:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947783.465947:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947783.465950:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1783947783.471320:0:24191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783947783.471341:0:24191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e7bc5510000) 00000020:00000080:3.0:1783947783.471372:0:24191:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1783947783.471693:0:24191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bfb129000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947783.471698:0:24191:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bfb129000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947783.471701:0:24191:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bfb129000 3 00010000:00080000:3.0:1783947783.471751:0:24191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac7c0c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947783.475358:0:24191:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1783947783.475502:0:24191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783947783.475552:0:24191:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947783.475567:0:24191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe6fd1fdb55501e0a 00000100:00080000:3.0:1783947783.475580:0:24191:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947783.475587:0:24191:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e7ac7c0c800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947783.475624:0:24191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9353800 x1870604236211200/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947783.475657:0:24191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783947783.475684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947783.475688:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947783.475691:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947783.475694:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947783.475698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947783.475708:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947783.475711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947783.475714:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947783.475790:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236211200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783947783.475871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783947783.477247:0:24191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1783947783.478013:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211200 00000100:00100000:3.0:1783947783.478026:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211200 00000100:00100000:3.0:1783947783.478108:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947783.478116:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236211200:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783947783.478150:0:22661:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:3.0:1783947783.478182:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe6fd1fdb55501e11 00000004:00100000:3.0:1783947783.478199:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947783.478232:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7c0b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947783.478341:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870604236211200:12345-0@lo:38:llog_process_th.0 Request processed in 224us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.478350:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783947783.478430:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bd9353800 x1870604236211200/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947783.478443:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947783.478451:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1783947783.478486:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783947783.478491:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783947783.478494:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7c0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783947783.478500:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236211200:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783947783.478909:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783947783.478951:0:24163:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947783.478990:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501de7 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947783.479002:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50200/0xe6fd1fdb55501de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501de7 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783947783.479058:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783947783.479061:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947783.479062:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947783.479064:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947783.479065:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947783.479066:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947783.479068:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947783.479070:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947783.479071:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947783.479075:0:24163:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783947783.479078:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947783.479079:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947783.479080:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947783.479081:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947783.479082:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947783.479084:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947783.479084:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947783.479086:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947783.479087:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947783.479113:0:24163:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783947783.479133:0:24163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236211328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947783.479186:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947783.479232:0:24163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.479345:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211328 00000100:00100000:0.0:1783947783.479351:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211328 00000100:00100000:0.0:1783947783.479430:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783947783.479439:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236211328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947783.479513:0:22655:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783947783.479526:0:22655:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783947783.486731:0:22655:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783947783.486749:0:22655:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783947783.487070:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24163:x1870604236211328:12345-0@lo:253:mount.lustre.0 Request processed in 7626us (7878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.487083:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947783.487191:0:24163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24163:1870604236211328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947783.487206:0:24163:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783947783.487210:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947783.487212:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947783.487213:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947783.487215:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947783.487216:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947783.487217:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947783.487218:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947783.487221:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947783.487222:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783947783.487247:0:24163:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1783947783.488083:0:22677:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947783.488091:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947783.488118:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488142:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488150:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488157:0:22677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488200:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488214:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947783.488227:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236211456:0@lo:104: 00000100:00100000:0.0:1783947783.488294:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947783.488354:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488379:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947783.488390:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236211584:0@lo:104: 00000100:00100000:0.0:1783947783.488422:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947783.488440:0:22677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947783.488492:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783947783.488507:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211456 00000100:00100000:0.0:1783947783.488513:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211456 00000100:00100000:0.0:1783947783.488545:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211584 00000100:00100000:0.0:1783947783.488547:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211584 00000100:00100000:0.0:1783947783.488561:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947783.488569:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:22677:x1870604236211456:12345-0@lo:104: 00010000:00010000:0.0:1783947783.488584:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488638:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947783.488644:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:22677:x1870604236211456:12345-0@lo:104: Request processed in 76us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.488652:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947783.488667:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947783.488674:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236211584:12345-0@lo:104: 00010000:00010000:0.0:1783947783.488681:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488712:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947783.488717:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236211584:12345-0@lo:104: Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947783.488729:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947783.488811:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236211456:0@lo:104: 00000100:00100000:0.0:1783947783.488820:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236211584:0@lo:104: 00010000:00010000:0.0:1783947783.488835:0:22677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488853:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947783.488859:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488867:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ba00 already unused, calling callback (ffffffffc11fcc20) 00010000:00010000:3.0:1783947783.488872:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1783947783.488877:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488887:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947783.488894:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947783.488900:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947783.488931:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488937:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947783.488962:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947783.488969:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236211712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947783.488970:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb55501d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d70 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947783.488989:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947783.488992:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947783.488994:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947783.489008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.489056:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211712 00000100:00100000:3.0:1783947783.489060:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211712 00010000:00010000:3.0:1783947783.489078:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947783.489123:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947783.489131:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3640:x1870604236211712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947783.489142:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947783.489148:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.489158:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.489171:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb55501d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501d69 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.489183:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947783.489214:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:3640:x1870604236211712:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.489221:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947783.489259:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236211712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947783.489999:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947783.490002:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947783.490004:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947783.490142:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490153:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947783.490157:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490166:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947783.490186:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947783.490199:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947783.490237:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490244:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947783.490264:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490272:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97c00/0xe6fd1fdb55501d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d62 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490302:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947783.490305:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947783.490307:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947783.490320:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236211840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947783.490375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947783.490437:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211840 00000100:00100000:3.0:1783947783.490443:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211840 00010000:00010000:3.0:1783947783.490492:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947783.490516:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947783.490523:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beb55a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:3637:x1870604236211840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947783.490533:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947783.490538:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490556:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490573:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501d5b expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490587:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490596:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947783.490612:0:22648:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008737447s 00010000:00010000:3.0:1783947783.490617:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490626:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490633:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490641:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490647:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947783.490651:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490660:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490681:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490694:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947783.490742:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beb55a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:3637:x1870604236211840:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947783.490751:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783947783.490851:0:22677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490860:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947783.490866:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e51e00/0xe6fd1fdb55501e18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947783.490913:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236211840:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1783947783.492273:0:24163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1783947783.500624:0:24163:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783947783.500635:0:24163:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783947783.500677:0:24163:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783947783.500743:0:24163:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783947783.500764:0:24163:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783947783.500795:0:24163:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1783947783.501696:0:24163:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947783.501932:0:24163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783947784.117175:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783947784.424491:0:24244:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947784.424715:0:24244:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783947785.141482:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947785.205979:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947785.205988:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be7b4d000 from 13 10000000:01000000:3.0:1783947785.205994:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947785.206048:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947785.206061:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947785.206074:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947785.206119:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236211968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947785.206193:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947785.206241:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947785.206486:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236211968 00000100:00100000:1.0:1783947785.206494:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236211968 00000100:00100000:1.0:1783947785.206544:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947785.206554:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+19:22658:x1870604236211968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947785.206568:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947785.206581:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501e1f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.206604:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.206613:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.206621:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438a00, rc 0) 00000100:00100000:1.0:1783947785.206663:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:22658:x1870604236211968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947785.206669:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783947785.206762:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236211968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947785.206777:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947785.206785:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947785.206834:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236212096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783947785.206865:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947785.206892:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947785.206996:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212096 00000100:00100000:2.0:1783947785.207001:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212096 00000100:00100000:2.0:1783947785.207035:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783947785.207043:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:22658:x1870604236212096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783947785.207059:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947785.207078:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947785.207081:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1783947785.207152:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:22658:x1870604236212096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947785.207159:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783947785.207221:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236212096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783947785.207287:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947785.207309:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947785.207316:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947785.207325:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947785.207327:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bf7a56000 from 13 10000000:01000000:3.0:1783947785.207329:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947785.207347:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947785.207363:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947785.207370:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947785.207384:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236212224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947785.207410:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947785.207438:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947785.207611:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212224 00000100:00100000:1.0:1783947785.207622:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212224 00000100:00100000:1.0:1783947785.207658:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947785.207664:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:22658:x1870604236212224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947785.207673:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947785.207682:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501e2d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.207698:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.207707:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.207714:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439800, rc 0) 00000100:00100000:1.0:1783947785.207896:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236212224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947785.207903:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947785.207937:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236212224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947785.207948:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.207956:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947785.207998:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236212352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783947785.208029:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947785.208044:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2d070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947785.208057:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212352 00000100:00100000:1.0:1783947785.208067:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212352 00000100:00100000:1.0:1783947785.208084:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947785.208091:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236212352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783947785.208102:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947785.208114:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947785.208116:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1783947785.208185:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236212352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947785.208192:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947785.208219:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236212352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783947785.208288:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947785.210488:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947785.210501:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947786.168709:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947786.486677:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947787.188578:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947788.212660:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947788.535028:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947788.535051:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236212608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947788.535117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947788.535162:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212608 00000100:00100000:1.0:1783947788.535169:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212608 00000100:00100000:1.0:1783947788.535230:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947788.535239:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236212608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947788.535277:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783947788.535324:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236212608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947788.535339:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947788.535388:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236212608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947788.535627:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236212480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947788.535654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947788.539698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947788.539704:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947788.539707:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947788.539710:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947788.539725:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947788.539728:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947788.539731:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947788.539734:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947788.539881:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212480 00000100:00100000:0.0:1783947788.539888:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212480 00000100:00100000:0.0:1783947788.539942:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947788.539951:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236212480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947788.539989:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947788.540068:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236212480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (4412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947788.540075:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947788.540111:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236212736:0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947788.540200:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236213248:0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947788.540243:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947788.540248:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236213120:0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947788.540287:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236212864:0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947788.540316:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947788.540320:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236212992:0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947788.540367:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236212480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947788.540390:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212736 00000100:00100000:0.0:1783947788.540393:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212736 00000100:00100000:0.0:1783947788.540421:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783947788.540427:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3640:x1870604236212736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540481:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3640:x1870604236212736:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947788.540487:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783947788.540510:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213248 00000100:00100000:0.0:1783947788.540512:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213248 00000100:00100000:0.0:1783947788.540534:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213120 00000100:00100000:0.0:1783947788.540536:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213120 00000100:00100000:0.0:1783947788.540549:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212864 00000100:00100000:0.0:1783947788.540551:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212864 00000100:00100000:0.0:1783947788.540561:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236212992 00000100:00100000:0.0:1783947788.540569:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236212992 00000100:00100000:0.0:1783947788.540585:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947788.540591:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236213248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540622:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236213248:12345-0@lo:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947788.540627:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947788.540639:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947788.540645:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236213120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540719:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236213120:12345-0@lo:400:kworker.0 Request processed in 73us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947788.540725:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947788.540736:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947788.540742:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236212864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540769:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236212864:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947788.540774:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947788.540786:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947788.540792:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236212992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540816:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236212992:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947788.540822:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1783947788.540846:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a16d80 x1870604236213120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947788.540858:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236213120:0@lo:400:kworker.0 00000100:00100000:0.0:1783947788.540866:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236212736:0@lo:400:kworker.0 00010000:00080000:0.0:1783947788.540885:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a17800 x1870604236213248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947788.540893:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236213248:0@lo:400:kworker.0 00010000:00080000:0.0:1783947788.540934:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a15c00 x1870604236212992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947788.540942:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236212992:0@lo:400:kworker.0 00010000:00080000:0.0:1783947788.540951:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a17b80 x1870604236212864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947788.540959:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236212864:0@lo:400:kworker.0 00000100:00080000:3.0:1783947788.541693:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947788.541700:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783947789.235567:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783947789.615288:0:24534:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783947790.264973:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947790.519682:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1783947790.637177:0:24587:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947790.637397:0:24587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783947791.285119:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783947791.712432:0:24638:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947791.712911:0:24638:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783947792.307622:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947792.693911:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947777/real 1783947777] req@ffff9e7bf3485180 x1870604236206080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947792 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.693951:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf3485180 x1870604236206080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947792 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.693962:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947777/real 1783947777] req@ffff9e7bf3485c00 x1870604236206208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947792 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.693974:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf3485c00 x1870604236206208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947792 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947792.693999:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947792.694028:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947792.694033:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236206080:0@lo:8:kworker.0 00000100:00080000:0.0:1783947792.694051:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947792.694058:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947792.694061:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236206208:0@lo:8:kworker.0 00000100:00080000:0.0:1783947792.695579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947792.695586:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947792.695590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947792.695964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947792.696004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947792.696007:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783947792.696011:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947792.696020:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 662 00000100:00080000:0.0:1783947792.696027:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947792.696036:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7bf34ca000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947792.696067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a16d80 x1870604236213888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947792.696086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947792.696090:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947792.696091:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947792.696095:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 662 00000100:00080000:0.0:1783947792.696098:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947792.696101:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947792.696126:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7a16a00 x1870604236214016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947792.696336:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236213376:0@lo:400:kworker.0 00000100:00100000:3.0:1783947792.696435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947792.696533:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947792.696540:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236213504:0@lo:400:kworker.0 00000100:00100000:3.0:1783947792.696574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947792.696630:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213376 00000100:00100000:3.0:1783947792.696640:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213376 00000100:00100000:3.0:1783947792.696699:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783947792.696709:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3637:x1870604236213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947792.696779:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3637:x1870604236213376:12345-0@lo:400:kworker.0 Request processed in 70us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947792.696786:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783947792.696826:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213504 00000100:00100000:3.0:1783947792.696830:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213504 00000100:00100000:3.0:1783947792.696858:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947792.696864:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236213504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947792.696901:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236213504:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947792.696908:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947792.696955:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236213504:0@lo:400:kworker.0 00000100:00100000:3.0:1783947792.696968:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236213376:0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697481:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236214272:0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.697550:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947792.697557:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236214144:0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.697622:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236213632:0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697650:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.697668:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236214400:0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.697701:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947792.697706:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236213760:0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.697766:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214272 00000100:00100000:0.0:1783947792.697771:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214272 00000100:00100000:0.0:1783947792.697830:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214144 00000100:00100000:0.0:1783947792.697833:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214144 00000100:00100000:0.0:1783947792.697847:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213632 00000100:00100000:0.0:1783947792.697850:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213632 00000100:00100000:0.0:1783947792.697862:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214400 00000100:00100000:0.0:1783947792.697864:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214400 00000100:00100000:0.0:1783947792.697879:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947792.697887:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236214272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.697934:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236214272:12345-0@lo:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.697941:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947792.697958:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947792.697976:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236214144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.698003:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236214144:12345-0@lo:400:kworker.0 Request processed in 29us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.698009:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947792.698021:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947792.698027:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236213632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.698058:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236213632:12345-0@lo:400:kworker.0 Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.698064:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947792.698076:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947792.698082:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236214400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.698121:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236214400:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.698127:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947792.698154:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213760 00000100:00100000:0.0:1783947792.700532:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213760 00000100:00100000:0.0:1783947792.700654:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947792.700665:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236213760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947792.700781:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236213760:12345-0@lo:400:kworker.0 Request processed in 118us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.700790:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783947792.708582:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947792.708596:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947792.708633:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236213888:0@lo:8:kworker.0 00000100:00100000:1.0:1783947792.708741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947792.708805:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236214016:0@lo:8:kworker.0 00000100:00100000:1.0:1783947792.708832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947792.708945:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236213760:0@lo:400:kworker.0 00010000:00080000:1.0:1783947792.708966:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a17800 x1870604236213632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947792.708980:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236213632:0@lo:400:kworker.0 00010000:00080000:1.0:1783947792.708994:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a15c00 x1870604236214400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947792.709003:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236214400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947792.710474:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236213888 00000100:00100000:2.0:1783947792.710489:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236213888 00000100:00100000:2.0:1783947792.710530:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214016 00000100:00100000:2.0:1783947792.710533:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214016 00010000:00080000:1.0:1783947792.710537:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a17100 x1870604236214144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947792.710548:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947792.710557:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236213888:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783947792.710558:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236214144:0@lo:400:kworker.0 00010000:00080000:1.0:1783947792.710594:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a17b80 x1870604236214272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947792.710612:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236214272:0@lo:400:kworker.0 00010000:00080000:2.0:1783947792.713962:0:24167:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:2.0:1783947792.714021:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501e3b 00002000:00100000:2.0:1783947792.714045:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e7c003f9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1783947792.714051:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1783947792.714054:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783947792.714295:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1783947792.714336:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9e7c003fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947792.714484:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236213888:12345-0@lo:8:kworker.0 Request processed in 3925us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947792.714496:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947792.714535:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947792.714542:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236214016:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783947792.714561:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7a16d80 x1870604236213888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:2.0:1783947792.714563:0:24167:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783947792.714575:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947792.714586:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783947792.714597:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783947792.714605:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783947792.714608:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783947792.714633:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783947792.714639:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236213888:0@lo:8:kworker.0 00000004:00080000:0.0:1783947792.714790:0:23403:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783947792.714820:0:23403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23403:1870604236214656:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783947792.714877:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.714905:0:23403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947792.714938:0:24169:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947792.714946:0:24169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783947792.715095:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947792.715119:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236214528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947792.715151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.716397:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214656 00000100:00100000:0.0:1783947792.716411:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214656 00000100:00080000:0.0:1783947792.716511:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947792.716642:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947792.716653:0:24673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23403:x1870604236214656:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1783947792.734404:0:23402:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947792.734565:0:23402:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677962107727ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783947792.734577:0:23402:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783947792.734586:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214528 00000100:00100000:1.0:1783947792.734602:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214528 00000100:00100000:1.0:1783947792.734695:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947792.734709:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1870604236214528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947792.735022:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947792.735331:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1870604236214528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 622us (20175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947792.735341:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783947792.735411:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7e83480 x1870604236214528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.735440:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236214528:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1783947792.753427:0:23394:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1783947792.760882:0:24673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783947792.760900:0:24673:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1783947792.761124:0:24673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23403:x1870604236214656:12345-0@lo:7:osp-pre-0-1.0 Request processed in 44455us (46228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947792.761145:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947792.761411:0:23403:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7e82680 x1870604236214656/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.761434:0:23403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23403:1870604236214656:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1783947792.761495:0:23403:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1783947792.761569:0:23403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23403:1870604236214784:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1783947792.761626:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.761658:0:23403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947792.761680:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214784 00000100:00100000:0.0:1783947792.761688:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214784 00000100:00100000:0.0:1783947792.761744:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947792.761756:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23403:x1870604236214784:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783947792.761813:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236214016:12345-0@lo:8:kworker.0 Request processed in 47257us (52967us total) trans 0 rc -19/-19 00002000:00080000:0.0:1783947792.761833:0:24169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1783947792.761849:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947792.761888:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23403:x1870604236214784:12345-0@lo:5:osp-pre-0-1.0 Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.761896:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783947792.761930:0:23403:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7e82680 x1870604236214784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.761939:0:23403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23403:1870604236214784:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1783947792.761949:0:23403:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1783947792.761981:0:23403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23403:1870604236214912:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1783947792.762004:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947792.762021:0:23403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947792.762031:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236214912 00000100:00100000:0.0:1783947792.762034:0:24673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236214912 00000100:00100000:0.0:1783947792.762059:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947792.762065:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23403:x1870604236214912:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783947792.762097:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:2.0:1783947792.762191:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947792.762199:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947792.762439:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236214016:0@lo:8:kworker.0 00000001:00080000:1.0:1783947792.811842:0:24164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1783947792.811856:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783947792.812364:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23403:x1870604236214912:12345-0@lo:5:osp-pre-0-1.0 Request processed in 50293us (50353us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1783947792.812389:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783947792.812551:0:23403:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7e82680 x1870604236214912/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947792.812563:0:23403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1783947792.812569:0:23403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23403:1870604236214912:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783947792.812584:0:23403:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1783947792.812703:0:23403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23403:1870604236215040:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783947792.812743:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947792.812767:0:23403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947792.814320:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215040 00000100:00100000:0.0:1783947792.814341:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215040 00000100:00100000:0.0:1783947792.814413:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947792.814425:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23403:x1870604236215040:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783947792.814747:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23403:x1870604236215040:12345-0@lo:900:osp-pre-0-1.0 Request processed in 323us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947792.814756:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783947792.814813:0:23403:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7be3fb0a80 x1870604236215040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947792.814846:0:23403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23403:1870604236215040:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1783947793.332250:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947793.652290:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947793.652315:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236215168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947793.652387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947793.652613:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236215296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947793.652643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947793.653837:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215168 00000100:00100000:3.0:1783947793.653848:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215168 00000100:00100000:3.0:1783947793.653905:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215296 00000100:00100000:3.0:1783947793.653909:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215296 00000100:00100000:3.0:1783947793.653927:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947793.653936:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236215168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947793.653976:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947793.654051:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236215168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947793.654060:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947793.654079:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947793.654113:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236215296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947793.654132:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947793.654163:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236215296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947793.654169:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783947793.654293:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236215296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947793.654308:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236215168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783947794.361311:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947795.380807:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947796.403882:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947796.725337:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947797.431809:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947797.747642:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947797.747663:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236215424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947797.747733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947797.747817:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215424 00000100:00100000:0.0:1783947797.747825:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215424 00000100:00080000:2.0:1783947797.747887:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947797.747888:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947797.747897:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236215424:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783947797.748065:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947797.748072:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947797.748075:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947797.748078:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947797.748100:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947797.748103:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947797.748107:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947797.748112:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:3.0:1783947797.748117:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783947797.748122:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947797.748140:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d6ad80 x1870604236216064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947797.748184:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236215680:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748256:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236216320:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748302:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783947797.748314:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236215808:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748347:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236216448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748386:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215680 00000100:00100000:3.0:1783947797.748390:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215680 00000100:00100000:3.0:1783947797.748417:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947797.748423:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236215680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748484:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236215680:12345-0@lo:400:kworker.0 Request processed in 61us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947797.748491:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947797.748634:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236215936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748679:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783947797.748684:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236215552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748727:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236216192:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947797.748765:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215552 00000100:00100000:3.0:1783947797.748769:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215552 00000100:00100000:3.0:1783947797.748794:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947797.748800:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3639:x1870604236215552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748832:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3639:x1870604236215552:12345-0@lo:400:kworker.0 Request processed in 32us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947797.748840:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947797.748884:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236215552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.748923:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236215680:0@lo:400:kworker.0 00002000:00000024:0.0:1783947797.749082:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947797.749128:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236215424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1232us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947797.749136:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947797.749164:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236216064:0@lo:8:kworker.0 00000100:00100000:0.0:1783947797.749300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947797.749335:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216320 00000100:00100000:0.0:1783947797.749339:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216320 00000100:00100000:0.0:1783947797.749374:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215808 00000100:00100000:0.0:1783947797.749377:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215808 00000100:00100000:0.0:1783947797.749386:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216448 00000100:00100000:0.0:1783947797.749389:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216448 00000100:00100000:0.0:1783947797.749399:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216192 00000100:00100000:0.0:1783947797.749401:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216192 00000100:00100000:0.0:1783947797.749413:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947797.749420:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236216320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947797.749487:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236216320:12345-0@lo:400:kworker.0 Request processed in 67us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947797.749494:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783947797.753668:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7e82d80 x1870604236215424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947797.753699:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236215424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947797.756286:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236215936 00000100:00100000:1.0:1783947797.756300:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236215936 00000100:00100000:1.0:1783947797.756412:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783947797.756422:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236215936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947797.756542:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236215936:12345-0@lo:400:kworker.0 Request processed in 121us (7880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947797.756557:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947797.757703:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947797.757721:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236215808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947797.757788:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236215808:12345-0@lo:400:kworker.0 Request processed in 74us (9452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947797.757795:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947797.757817:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947797.757825:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236216448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947797.757856:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236216448:12345-0@lo:400:kworker.0 Request processed in 33us (9489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947797.757862:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947797.757875:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947797.757882:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236216192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947797.757915:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236216192:12345-0@lo:400:kworker.0 Request processed in 33us (9166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947797.757920:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947797.757952:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216064 00000100:00100000:0.0:1783947797.757959:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216064 00000100:00100000:0.0:1783947797.757988:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947797.757994:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236216064:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783947797.758028:0:24170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783947797.758066:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236216064:12345-0@lo:8:kworker.0 Request processed in 71us (8766us total) trans 0 rc -19/-19 00010000:00080000:3.0:1783947797.758649:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d69c00 x1870604236216192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947797.758665:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236216192:0@lo:400:kworker.0 00000100:00100000:3.0:1783947797.758680:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236215936:0@lo:400:kworker.0 00000100:00100000:0.0:1783947797.759073:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783947797.759296:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947797.759301:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783947797.759305:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236216064:0@lo:8:kworker.0 00000100:00080000:0.0:1783947797.759326:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947797.759330:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783947797.759349:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bd9353100 x1870604236215808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947797.759359:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236215808:0@lo:400:kworker.0 00010000:00080000:0.0:1783947797.759371:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6a680 x1870604236216448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947797.759378:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236216448:0@lo:400:kworker.0 00010000:00080000:0.0:1783947797.759389:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68a80 x1870604236216320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947797.759397:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236216320:0@lo:400:kworker.0 00010000:00010000:2.0:1783947798.458768:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947798.772829:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947778/real 1783947778] req@ffff9e7bd9352300 x1870604236207488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947798 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.772858:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bd9352300 x1870604236207488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947798 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.772868:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947778/real 1783947778] req@ffff9e7bd9352d80 x1870604236207616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947798 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.772879:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bd9352d80 x1870604236207616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947798 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947798.772898:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947798.772918:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947798.772922:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236207488:0@lo:8:kworker.0 00000100:00080000:3.0:1783947798.772928:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947798.772932:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947798.772935:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236207616:0@lo:8:kworker.0 00000100:00080000:2.0:1783947798.773170:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947798.773175:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783947798.773178:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947798.773182:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:2.0:1783947798.773187:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783947798.773194:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bc48d2000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947798.773214:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac8623b80 x1870604236216832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947798.773227:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947798.773230:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783947798.773231:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947798.773234:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:2.0:1783947798.773237:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783947798.773240:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947798.773250:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac8623480 x1870604236216960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947798.773296:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947798.773299:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783947798.773301:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947798.773304:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:2.0:1783947798.773306:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783947798.773309:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947798.773320:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac8620000 x1870604236217472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947798.773360:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236216704:0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.773434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.773492:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236217600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.773520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.773542:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783947798.773547:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236216576:0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.773573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.773599:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236217344:0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.773621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947798.773753:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236217216:0@lo:400:kworker.0 00000100:00100000:3.0:1783947798.773784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947798.773813:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236217856:0@lo:400:kworker.0 00000100:00100000:3.0:1783947798.773834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947798.773852:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947798.773858:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236217088:0@lo:400:kworker.0 00000100:00100000:3.0:1783947798.773878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947798.774591:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216576 00000100:00100000:1.0:1783947798.774603:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216576 00000100:00100000:1.0:1783947798.774659:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783947798.774668:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3640:x1870604236216576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947798.774733:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3640:x1870604236216576:12345-0@lo:400:kworker.0 Request processed in 66us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.774740:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783947798.775373:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236217984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947798.775412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.775441:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947798.775447:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236218112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947798.775494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.775517:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216704 00000100:00100000:0.0:1783947798.775522:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216704 00000100:00100000:0.0:1783947798.775554:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217216 00000100:00100000:0.0:1783947798.775558:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217216 00000100:00100000:0.0:1783947798.775586:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217984 00000100:00100000:0.0:1783947798.775589:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217984 00000100:00100000:0.0:1783947798.775598:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218112 00000100:00100000:0.0:1783947798.775601:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218112 00000100:00100000:0.0:1783947798.775612:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947798.775618:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870604236216704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947798.775662:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870604236216704:12345-0@lo:400:kworker.0 Request processed in 44us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947798.775669:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947798.775686:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947798.775693:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236217216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947798.775738:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236217216:12345-0@lo:400:kworker.0 Request processed in 46us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947798.775744:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947798.775757:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947798.775763:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236217984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947798.775789:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947798.775822:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236217984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947798.775829:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947798.775840:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947798.775846:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236218112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947798.775861:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783947798.775887:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236218112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947798.775893:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947798.775945:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236218112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947798.775958:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236217984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947798.776362:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236216704:0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.776386:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236216576:0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.776427:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236216832:0@lo:8:kworker.0 00000100:00100000:2.0:1783947798.776490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.776519:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236216960:0@lo:8:kworker.0 00000100:00100000:2.0:1783947798.776555:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.776573:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236217472:0@lo:8:kworker.0 00000100:00100000:2.0:1783947798.776593:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.776623:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217344 00000100:00100000:2.0:1783947798.776628:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217344 00000100:00100000:2.0:1783947798.776652:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216832 00000100:00100000:2.0:1783947798.776655:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216832 00000100:00100000:2.0:1783947798.776664:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236216960 00000100:00100000:2.0:1783947798.776666:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236216960 00000100:00100000:2.0:1783947798.776672:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217472 00000100:00100000:2.0:1783947798.776674:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217472 00000100:00100000:2.0:1783947798.776682:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947798.776689:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236217344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947798.776736:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236217344:12345-0@lo:400:kworker.0 Request processed in 46us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947798.776741:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947798.776755:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947798.776758:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236216832:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783947798.776784:0:24170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:2.0:1783947798.776812:0:24170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501e42 00002000:00100000:2.0:1783947798.776826:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e7c003f9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783947798.776830:0:24170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783947798.776833:0:24170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783947798.776910:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783947798.776937:0:24170:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947798.776974:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236216832:12345-0@lo:8:kworker.0 Request processed in 214us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947798.777349:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947798.777368:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947798.777372:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236216960:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783947798.777385:0:24170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783947798.777417:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236216960:12345-0@lo:8:kworker.0 Request processed in 43us (861us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947798.777423:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947798.777435:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947798.777439:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236217472:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783947798.777448:0:24170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783947798.777569:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236217472:12345-0@lo:8:kworker.0 Request processed in 128us (974us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947798.777575:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783947798.777618:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8623b80 x1870604236216832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947798.777628:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947798.777636:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783947798.777644:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783947798.777649:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783947798.777652:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783947798.777669:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783947798.777674:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236216832:0@lo:8:kworker.0 00000100:00080000:2.0:1783947798.777685:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947798.777688:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947798.777697:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236216960:0@lo:8:kworker.0 00000100:00080000:2.0:1783947798.777706:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947798.777709:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947798.777712:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236217472:0@lo:8:kworker.0 00000004:00080000:2.0:1783947798.777759:0:22686:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1783947798.777777:0:22686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22686:1870604236218368:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783947798.777802:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.777821:0:22686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947798.777833:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218368 00000100:00100000:2.0:1783947798.777837:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218368 00000100:00100000:2.0:1783947798.777872:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947798.777878:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22686:x1870604236218368:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783947798.778408:0:22685:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783947798.778508:0:22685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 684006050382ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783947798.778515:0:22685:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783947798.779436:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236218240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947798.779509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.779551:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218240 00000100:00100000:0.0:1783947798.779557:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218240 00000100:00100000:0.0:1783947798.779591:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947798.779598:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236218240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947798.779624:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947798.779663:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236218240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947798.779669:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947798.779704:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8620000 x1870604236218240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947798.779722:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236218240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947798.780148:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236217728:0@lo:400:kworker.0 00000100:00100000:3.0:1783947798.780180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947798.780385:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947798.780421:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8623800 x1870604236217344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947798.780432:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236217344:0@lo:400:kworker.0 00000020:01000004:0.0:1783947798.781875:0:24983:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783947798.781878:0:24983:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783947798.781879:0:24983:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1783947798.781983:0:24983:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7be3edb000 00000020:01000004:0.0:1783947798.782009:0:24983:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783947798.782021:0:24983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783947798.782035:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e7ac7798000) 00000020:00000080:0.0:1783947798.782052:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1783947798.783096:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236217216:0@lo:400:kworker.0 00000100:00100000:1.0:1783947798.783277:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217600 00000100:00100000:1.0:1783947798.783287:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217600 00000100:00100000:1.0:1783947798.783323:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217856 00000100:00100000:1.0:1783947798.783326:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217856 00000100:00100000:1.0:1783947798.783361:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217088 00000100:00100000:1.0:1783947798.783364:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217088 00000100:00100000:1.0:1783947798.783376:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236217728 00000100:00100000:1.0:1783947798.783379:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236217728 00000100:00100000:1.0:1783947798.783393:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947798.783402:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236217856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947798.783730:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236217856:12345-0@lo:400:kworker.0 Request processed in 328us (9893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.783737:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947798.783757:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947798.783764:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236217088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947798.783794:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236217088:12345-0@lo:400:kworker.0 Request processed in 32us (9916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.783800:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947798.783811:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947798.783830:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236217728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947798.783861:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236217728:12345-0@lo:400:kworker.0 Request processed in 32us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.783867:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783947798.785374:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8621880 x1870604236217088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.785392:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236217088:0@lo:400:kworker.0 00010000:00080000:3.0:1783947798.785408:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8622680 x1870604236217728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.785417:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236217728:0@lo:400:kworker.0 00010000:00080000:3.0:1783947798.785427:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8621f80 x1870604236217856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.785435:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236217856:0@lo:400:kworker.0 00000100:00100000:1.0:1783947798.786810:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947798.786822:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236217600:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1783947798.786862:0:22641:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1783947798.786888:0:24170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1783947798.786895:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1783947798.786900:0:24170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000100:00100000:1.0:1783947798.786905:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236217600:12345-0@lo:400:kworker.0 Request processed in 86us (13385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.786912:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1783947798.787591:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8620380 x1870604236217600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947798.787608:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236217600:0@lo:400:kworker.0 00002000:00010000:3.0:1783947798.797799:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.797810:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.797838:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.797842:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.797849:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.797867:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.797878:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.797886:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.797956:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.798128:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.798136:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.798145:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.798150:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.798159:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.798178:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.798186:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501e50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.798217:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.798219:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.798221:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.799038:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.799120:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.799132:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.799135:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.799141:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.799152:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.799175:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.799181:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.799229:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947798.799758:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.799766:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.799775:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.799778:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.799789:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.799801:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.799820:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.799827:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802450:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947798.802480:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802496:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.802501:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802512:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802540:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802547:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501e57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802573:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.802578:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802585:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5fa00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.802599:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802607:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802618:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.802625:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.802627:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.802629:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.802822:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947798.802838:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb55501e5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947798.803584:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.803593:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.803606:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.803611:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.803617:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.803628:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.803650:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.803657:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.803775:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947798.803788:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.803795:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947798.803800:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.803819:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.803923:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.804016:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.804019:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.804029:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947798.804034:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501e65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947798.804573:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.804580:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.804589:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.804593:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.804597:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.804606:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.804613:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.804631:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.804716:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947798.804722:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.804730:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947798.804734:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.804741:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.804752:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.804771:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947798.804773:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947798.804775:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.805253:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.805447:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947798.805489:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5a6932/0xe6fd1fdb55501e6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.805679:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.805841:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.805848:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.805858:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.805862:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.805866:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.805877:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.805884:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.805891:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.805954:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947798.806328:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.806334:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.806343:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.806345:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.806349:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.806357:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.806364:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.806371:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806596:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947798.806604:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806612:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.806617:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806625:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806641:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806655:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55501e73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806671:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.806674:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806680:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.806684:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806692:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806702:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.806709:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.806710:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.806712:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.806791:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947798.806797:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501e7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.807002:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.807279:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.807286:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807300:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.807303:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.807314:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807325:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807333:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807340:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807361:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947798.807708:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.807714:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807722:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.807726:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.807730:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807739:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807758:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807766:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.807781:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947798.808241:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947798.808249:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808257:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.808261:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808270:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808284:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808291:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c120409b/0xe6fd1fdb55501e81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808307:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947798.808317:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808325:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ea00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.808328:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808336:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808346:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808353:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a714f7d6/0xe6fd1fdb55501e88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.808366:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.808368:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.808370:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.808531:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.809271:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.809281:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.809293:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.809298:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.809303:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.809315:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.809323:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.809331:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.809365:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.809753:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.809760:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.809779:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.809784:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.809793:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.809806:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.809828:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55501e8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.809845:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.809846:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.809848:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.810640:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.810650:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.810662:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.810666:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.810671:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.810683:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.810692:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.810700:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.810724:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947798.810742:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947798.810748:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.810756:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.810759:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.810779:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.810791:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.810799:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000631f9d3e/0xe6fd1fdb55501e96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.810835:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.810837:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.810838:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.811149:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.811155:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.811164:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.811173:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.811178:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.811187:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.811196:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.811203:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.811226:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947798.813423:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.813436:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.813453:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.813483:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.813490:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.813504:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.813514:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.813536:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.813566:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947798.813615:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947798.813623:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813631:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ee00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.813635:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813643:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813660:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813677:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000185b63f9/0xe6fd1fdb55501e9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813696:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947798.813699:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813704:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.813708:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813715:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813725:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813732:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27fbc95/0xe6fd1fdb55501ea4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.813743:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.813744:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.813746:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.814250:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.816210:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.816223:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816239:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.816243:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.816248:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816261:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816270:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816277:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816403:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947798.816440:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947798.816447:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.816491:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.816495:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.816504:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.816521:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.816529:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed136bbf/0xe6fd1fdb55501eab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.816547:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.816549:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.816550:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.816869:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.816875:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816890:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.816893:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.816898:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816907:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816915:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816923:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.816947:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947798.817185:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947798.817192:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.817200:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947798.817203:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.817211:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.817229:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.817235:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501eb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.817250:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.817251:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.817253:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.818403:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.818414:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.818427:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.818431:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.818436:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.818447:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.818484:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.818492:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.818514:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.818821:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.818837:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.818845:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.818850:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.818874:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.818890:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.818898:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000500641d6/0xe6fd1fdb55501eb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.818918:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.818919:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.818921:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.820343:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.820355:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.820369:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.820383:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.820395:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.820411:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.820421:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.820428:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.820494:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.820686:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.820693:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.820701:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ba00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.820705:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.820714:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.820730:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.820748:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb55501ec0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.820764:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.820766:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.820767:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.821242:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.821251:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.821260:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.821264:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.821269:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.821278:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.821287:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.821295:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.821350:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947798.822160:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.822168:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.822179:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.822188:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.822192:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.822202:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.822211:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.822218:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826212:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947798.826227:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826241:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.826246:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826257:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826281:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826288:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee61a6b5/0xe6fd1fdb55501ec7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826307:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.826316:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826338:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ac00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.826341:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826349:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826360:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.826367:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.826369:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.826384:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.826783:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947798.826793:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501ece lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.826840:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.827753:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.827762:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.827776:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.827781:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.827788:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.827801:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.827821:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.827829:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.827894:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947798.828308:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.828323:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.828333:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.828336:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.828339:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.828349:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.828356:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.828363:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828694:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947798.828703:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828712:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947798.828716:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828725:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828742:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828749:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501ed5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828775:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947798.828778:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828784:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947798.828795:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828802:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828813:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.828821:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947798.828823:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947798.828825:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.828969:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947798.828974:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb55501edc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947798.829526:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.829534:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.829544:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.829547:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.829552:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.829561:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.829568:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.829576:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.829625:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947798.829632:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.829639:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947798.829643:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.829651:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.829663:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.829683:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.829685:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.829687:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.839499:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.840580:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947798.840593:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ee3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947798.841181:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.842452:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.842483:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.842487:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.842494:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.842508:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.842519:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.842527:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.842552:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947798.843798:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.843819:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.843841:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.843846:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.843858:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.843871:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.843879:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.843886:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.843909:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783947798.844835:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947798.844846:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844856:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.844861:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844871:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844889:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844907:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b26a39f/0xe6fd1fdb55501eea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844931:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.844934:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844942:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.844945:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844952:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844962:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844969:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501ef1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.844983:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.844985:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.844987:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.846359:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.846369:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.846385:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.846389:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.846397:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.846410:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.846419:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.846438:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.846491:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.847348:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.847357:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.847372:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.847377:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.847387:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.847406:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.847413:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ffd8a43/0xe6fd1fdb55501ef8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.847436:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.847437:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.847439:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.848250:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.848540:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.848548:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.848562:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.848566:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.848572:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.848584:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.848592:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.848601:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.848616:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.849592:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.849601:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.849610:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.849615:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.849634:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.849665:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.849672:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004aa437f0/0xe6fd1fdb55501eff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.849690:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.849691:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.849693:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.849901:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.849908:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.849924:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.849928:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.849932:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.849942:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.849949:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.849956:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.849977:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947798.850280:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.850286:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.850294:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.850297:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.850305:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.850316:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.850334:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e924523a/0xe6fd1fdb55501f06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.850348:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.850350:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.850352:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947798.851374:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.851383:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.851395:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.851399:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.851404:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.851416:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.851436:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.851442:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.852187:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947798.852884:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.852894:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.852907:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.852910:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.852916:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.852928:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.852937:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.852944:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.855872:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947798.855885:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.855899:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.855904:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.855916:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.855936:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.855944:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d7d11df/0xe6fd1fdb55501f0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.855971:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.855976:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.856001:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.856005:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.856013:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.856024:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.856034:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.856035:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.856038:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.856953:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947798.856962:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdbc7146/0xe6fd1fdb55501f14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947798.858306:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947798.858316:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.858332:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1783947798.858336:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947798.858343:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.858356:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.858365:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.858373:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.859616:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.859627:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.859638:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.859642:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.859652:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.859673:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.859806:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.859814:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.859817:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947798.863317:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947798.863331:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015faff52/0xe6fd1fdb55501f1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.863439:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947798.864090:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.864100:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864115:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.864121:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.864128:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864142:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864152:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864162:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864225:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947798.864648:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947798.864655:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864664:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1783947798.864667:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947798.864671:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864689:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864696:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.864703:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868800:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947798.868822:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868837:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.868842:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868855:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868878:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868886:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501f22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868910:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947798.868913:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868920:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947798.868923:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868943:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868952:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.868960:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.868961:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947798.868963:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947798.871242:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947798.871254:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c9abb7f/0xe6fd1fdb55501f29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783947798.871564:0:24170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1783947798.871661:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22686:x1870604236218368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93777us (93852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947798.871671:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947798.872097:0:22686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22686:1870604236218368:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783947798.872115:0:22686:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1783947798.872162:0:22686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22686:1870604236218496:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783947798.872201:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947798.872239:0:22686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7190300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947798.872351:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218496 00000100:00100000:1.0:1783947798.872358:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218496 00000100:00100000:1.0:1783947798.872421:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947798.872431:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22686:x1870604236218496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783947798.872499:0:24167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1783947798.878524:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783947798.881418:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783947798.890602:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783947798.891333:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783947798.891713:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783947798.892000:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783947798.892279:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783947798.892633:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00000001:00080000:1.0:1783947798.894028:0:24164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00080000:01000000:3.0:1783947798.894221:0:24983:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000001:00100000:1.0:1783947798.894672:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947798.894741:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783947798.894757:0:24983:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000100:00100000:2.0:1783947798.895229:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22686:x1870604236218496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22796us (23024us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1783947798.895241:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:00000080:2.0:1783947798.895278:0:24983:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6fd1fdb55501f30 00000020:01000004:2.0:1783947798.895287:0:24983:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783947798.895311:0:24983:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783947798.895314:0:24983:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783947798.895329:0:24983:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783947798.895371:0:24983:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1783947798.895376:0:24983:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:3.0:1783947798.899545:0:22686:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1783947798.899559:0:22686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22686:1870604236218496:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783947798.899578:0:22686:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:01000000:2.0:1783947798.909314:0:24983:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783947798.909361:0:24983:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783947798.909366:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783947798.909368:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947798.909369:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947798.909370:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947798.909371:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947798.909373:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947798.909374:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947798.909376:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947798.909377:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947798.909381:0:24983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783947798.909383:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947798.909385:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947798.909442:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947798.909443:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947798.909444:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947798.909446:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947798.909447:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947798.909448:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947798.909449:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947798.909555:0:24983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783947798.909577:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236218624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947798.909655:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.909706:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.909789:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218624 00000100:00100000:3.0:1783947798.909798:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218624 00000100:00100000:3.0:1783947798.909983:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783947798.910002:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24983:x1870604236218624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783947798.910038:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783947798.910041:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783947798.910065:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783947798.910530:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24983:x1870604236218624:12345-0@lo:253:mount.lustre.0 Request processed in 528us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.910538:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783947798.910645:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236218624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783947798.910656:0:24983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783947798.910658:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947798.910660:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947798.910661:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947798.910662:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947798.910663:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947798.910672:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947798.910673:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947798.910675:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947798.910676:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783947798.910694:0:24983:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7be3edb000 from lustre-OST0001 10000000:01000000:2.0:1783947798.910719:0:24983:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783947798.910722:0:24983:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783947798.910730:0:24983:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7bc47bb380 local copy 00010000:00010000:2.0:1783947798.910739:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947798.911042:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236218752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947798.911085:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.911275:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947798.911358:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218752 00000100:00100000:1.0:1783947798.911364:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218752 00000100:00100000:1.0:1783947798.911406:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783947798.911415:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24983:x1870604236218752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947798.911525:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24983:x1870604236218752:12345-0@lo:501:mount.lustre.0 Request processed in 111us (438us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947798.911532:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783947798.911634:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236218752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783947798.911647:0:24983:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947798.911667:0:24983:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947798.911674:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.911684:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438800/0xe6fd1fdb55501b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501b6a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947798.911711:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7be3edb000 10000000:01000000:2.0:1783947798.911716:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783947798.911721:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783947798.911723:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947798.911728:0:24983:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783947798.911731:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783947798.911754:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.911771:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.911780:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947798.911793:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236218880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947798.911833:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.911850:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947798.912138:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236218880 00000100:00100000:1.0:1783947798.912143:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236218880 00000100:00100000:1.0:1783947798.912167:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947798.912181:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:24983:x1870604236218880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947798.912193:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947798.912205:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501f37 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.912229:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f37 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.912239:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438c00/0xe6fd1fdb55501f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f37 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947798.912247:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438c00, rc 0) 00000100:00100000:1.0:1783947798.912287:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236218880:12345-0@lo:101:mount.lustre.0 Request processed in 107us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.912294:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783947798.912368:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236218880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947798.912381:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f3e expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.912399:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501f3e expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947798.913696:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1783947798.914640:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947798.919214:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783947798.919280:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783947798.919296:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783947798.919309:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783947798.919323:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783947798.919338:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783947798.919352:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783947798.919367:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783947798.919381:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1783947798.919422:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1783947798.919438:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1783947798.919596:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947798.919674:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.919724:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.919854:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219008 00000100:00100000:3.0:1783947798.919863:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219008 00000100:00100000:3.0:1783947798.919920:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783947798.919930:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947798.920374:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219008:12345-0@lo:501:mount.lustre.0 Request processed in 445us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.920390:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783947798.920617:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947798.920653:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947798.920696:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.920716:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.920784:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219136 00000100:00100000:3.0:1783947798.920788:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219136 00000100:00100000:3.0:1783947798.920830:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783947798.920838:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947798.921871:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219136:12345-0@lo:503:mount.lustre.0 Request processed in 1030us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.921880:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783947798.921969:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947798.922412:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947798.922521:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947798.922561:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.922591:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.922959:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219264 00000100:00100000:3.0:1783947798.922966:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219264 00000100:00100000:3.0:1783947798.923014:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783947798.923023:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947798.924082:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219264:12345-0@lo:502:mount.lustre.0 Request processed in 1055us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.924092:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783947798.924668:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947798.924904:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783947798.924953:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783947798.924968:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783947798.924981:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783947798.925008:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783947798.925022:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783947798.925034:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783947798.925159:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783947798.925181:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1783947798.925216:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947798.925266:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.925295:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947798.925394:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219392 00000100:00100000:0.0:1783947798.925401:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219392 00000100:00100000:0.0:1783947798.925452:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783947798.925599:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947798.925706:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219392:12345-0@lo:502:mount.lustre.0 Request processed in 111us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947798.925713:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947798.925840:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947798.925884:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1783947798.925893:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1783947798.926954:0:24988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783947798.926964:0:24988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1783947798.926975:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947798.926977:0:24988:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783947798.926983:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947798.927007:0:24988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e7bf3fb0000) 00000020:00000080:3.0:1783947798.927030:0:24988:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783947798.927035:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783947798.927181:0:24988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7be3edb000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783947798.927191:0:24988:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947798.927197:0:24988:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6fd1fdb55501f4c 00010000:00010000:3.0:1783947798.932281:0:24988:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1783947798.933144:0:24988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1783947798.935206:0:24988:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1783947798.940331:0:24988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783947798.940345:0:24988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947798.940352:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.940354:0:24988:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783947798.940358:0:24988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947798.940362:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.940363:0:24988:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947798.940366:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947798.940369:0:24988:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947798.940371:0:24988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947798.940374:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.940375:0:24988:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783947798.940377:0:24988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947798.940379:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.940381:0:24988:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783947798.940384:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783947798.940610:0:24988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947798.940614:0:24988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.940616:0:24988:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783947798.940619:0:24988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1783947798.945334:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783947798.945378:0:24983:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783947798.945403:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f3e expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.945415:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a000/0xe6fd1fdb55501f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f3e expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947798.948346:0:24983:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be3edb000 from 1 10000000:01000000:2.0:1783947798.948355:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947798.949022:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.949035:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.949108:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947798.949146:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947798.949218:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.949305:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947798.951783:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219520 00000100:00100000:0.0:1783947798.951796:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219520 00000100:00100000:2.0:1783947798.952035:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947798.952107:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:24983:x1870604236219520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947798.952126:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947798.952145:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501f53 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.952172:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.952183:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.952192:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:2.0:1783947798.952270:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219520:12345-0@lo:101:mount.lustre.0 Request processed in 226us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947798.952277:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783947798.952365:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947798.952383:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947798.952402:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947798.953813:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1783947798.954122:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947798.954328:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783947798.954355:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1783947798.954369:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1783947798.954382:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1783947798.954409:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1783947798.954423:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1783947798.954436:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1783947798.954448:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1783947798.954503:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1783947798.954519:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1783947798.954544:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1783947798.954563:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1783947798.954567:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1783947798.954643:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947798.954706:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.955341:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.955396:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219648 00000100:00100000:3.0:1783947798.955405:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219648 00000100:00100000:3.0:1783947798.955443:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783947798.955452:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947798.955708:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219648:12345-0@lo:501:mount.lustre.0 Request processed in 256us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.955717:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783947798.955826:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947798.955880:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947798.955919:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.955946:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.956071:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219776 00000100:00100000:3.0:1783947798.956075:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219776 00000100:00100000:3.0:1783947798.956093:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783947798.956099:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947798.956186:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219776:12345-0@lo:503:mount.lustre.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.956192:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783947798.956341:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783947798.956757:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947798.957026:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947798.957084:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.957102:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.957232:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236219904 00000100:00100000:3.0:1783947798.957237:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236219904 00000100:00100000:3.0:1783947798.957264:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783947798.957270:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947798.957376:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236219904:12345-0@lo:502:mount.lustre.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.957392:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783947798.957720:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236219904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947798.958044:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783947798.958147:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1783947798.958161:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1783947798.958176:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1783947798.958190:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1783947798.958203:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1783947798.958217:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1783947798.958231:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1783947798.958245:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1783947798.958258:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1783947798.958273:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1783947798.958311:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947798.958354:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947798.958380:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.958658:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220032 00000100:00100000:3.0:1783947798.958664:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220032 00000100:00100000:3.0:1783947798.958700:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783947798.958709:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236220032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947798.958799:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236220032:12345-0@lo:502:mount.lustre.0 Request processed in 91us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.958821:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783947798.959202:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783947798.959264:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1783947798.959276:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783947798.961288:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947798.961302:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.961305:0:24992:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947798.961312:0:24992:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7be3edb000 00000020:00000080:2.0:1783947798.961315:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947798.961322:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947798.961325:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.961326:0:24992:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783947798.961329:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947798.961342:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.961343:0:24992:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783947798.961347:0:24992:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7be3edb000 00000020:00000080:2.0:1783947798.961349:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947798.961638:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947798.961643:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.961645:0:24992:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783947798.961647:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947798.961650:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947798.961651:0:24992:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947798.961654:0:24992:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7be3edb000 00000020:00000080:2.0:1783947798.961656:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947798.963142:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947798.966578:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947798.966588:0:24992:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947798.966602:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947798.966610:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947798.966611:0:24992:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783947798.966616:0:24992:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7be3edb000 00000020:00000080:3.0:1783947798.966619:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947798.966700:0:24992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947798.966704:0:24992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947798.966705:0:24992:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783947798.966709:0:24992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1783947798.972571:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783947798.972620:0:24983:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947798.972651:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.972665:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947798.972733:0:24983:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783947798.972737:0:24983:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7be3edb000 10000000:01000000:2.0:1783947798.972740:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7be3edb000 10000000:01000000:2.0:1783947798.972744:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947798.972751:0:24983:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7be3edb000 from 1 10000000:01000000:2.0:1783947798.972754:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947798.972791:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.972801:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.973598:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947798.973630:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947798.973723:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.973776:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.974565:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220160 00000100:00100000:3.0:1783947798.974574:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220160 00000100:00100000:3.0:1783947798.974623:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783947798.974633:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:24983:x1870604236220160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947798.974650:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947798.974667:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d50c00/0xe6fd1fdb55501f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501f61 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.974708:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d50c00/0xe6fd1fdb55501f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f61 expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.974720:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d50c00/0xe6fd1fdb55501f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f61 expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947798.974730:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d50c00, rc 0) 00000100:00100000:3.0:1783947798.974786:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220160:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.974793:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783947798.975229:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947798.975246:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f68 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947798.975255:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501f68 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947798.980565:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1783947798.980895:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947798.982675:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783947798.982727:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783947798.982744:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783947798.982760:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783947798.982775:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783947798.982790:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783947798.982820:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783947798.982837:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783947798.982850:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783947798.982863:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783947798.982876:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783947798.982889:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783947798.982921:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783947798.982939:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783947798.982963:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783947798.982978:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783947798.983007:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783947798.983023:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783947798.983036:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783947798.984640:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783947798.984682:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783947798.984698:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783947798.984711:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783947798.984724:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783947798.984736:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1783947798.984749:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1783947798.984762:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1783947798.984775:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1783947798.985615:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1783947798.985646:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1783947798.985662:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1783947798.985675:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1783947798.985688:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1783947798.985703:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1783947798.985718:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1783947798.985733:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1783947798.985748:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1783947798.985762:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1783947798.985775:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1783947798.985790:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1783947798.987376:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1783947798.987578:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1783947798.987594:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1783947798.987608:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1783947798.987636:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1783947798.987650:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1783947798.987663:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1783947798.987684:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1783947798.987841:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1783947798.987861:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1783947798.987878:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1783947798.987884:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1783947798.988014:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947798.989852:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.989901:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947798.990684:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220288 00000100:00100000:1.0:1783947798.990695:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220288 00000100:00100000:1.0:1783947798.990748:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783947798.990758:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947798.990918:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220288:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947798.990926:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947798.991175:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947798.991222:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947798.991267:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.991292:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.991347:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220416 00000100:00100000:3.0:1783947798.991352:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220416 00000100:00100000:3.0:1783947798.991395:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783947798.991403:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947798.991525:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220416:12345-0@lo:503:mount.lustre.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.991532:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947798.992180:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220416:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947798.994168:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947798.994264:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947798.994339:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947798.995141:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947798.995544:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220544 00000100:00100000:3.0:1783947798.995552:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220544 00000100:00100000:3.0:1783947798.995604:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783947798.995613:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947798.995765:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220544:12345-0@lo:502:mount.lustre.0 Request processed in 152us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947798.995772:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783947798.995953:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947798.996704:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1783947798.996743:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1783947798.996758:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1783947798.996772:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1783947798.996787:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1783947798.996803:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1783947798.996818:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1783947798.996849:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1783947798.996866:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1783947798.996888:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1783947798.996902:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1783947798.996915:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1783947798.996928:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1783947798.996940:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1783947798.996951:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1783947798.996964:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1783947798.996979:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1783947798.997007:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1783947798.997024:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1783947798.997038:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1783947798.998752:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1783947798.998787:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1783947798.998808:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1783947798.998845:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1783947798.998861:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1783947798.998874:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1783947798.998888:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1783947798.998901:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1783947798.998915:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1783947798.998929:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1783947798.998942:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1783947798.998955:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1783947798.998967:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1783947798.998980:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1783947798.999008:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1783947798.999021:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1783947798.999034:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1783947799.000170:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1783947799.000210:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1783947799.000245:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1783947799.000264:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1783947799.000280:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1783947799.000305:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1783947799.000322:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1783947799.000336:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1783947799.000349:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1783947799.000363:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1783947799.000377:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1783947799.001765:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947799.001848:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.001893:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947799.002787:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220672 00000100:00100000:3.0:1783947799.002797:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220672 00000100:00100000:3.0:1783947799.002871:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783947799.002881:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947799.003054:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220672:12345-0@lo:502:mount.lustre.0 Request processed in 165us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947799.003062:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783947799.003366:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947799.003756:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1783947799.003784:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1783947799.003818:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947799.003865:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.003901:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947799.005531:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220800 00000100:00100000:3.0:1783947799.005543:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220800 00000100:00100000:3.0:1783947799.005601:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783947799.005611:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947799.005749:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236220800:12345-0@lo:502:mount.lustre.0 Request processed in 139us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947799.005758:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783947799.005949:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236220800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947799.006039:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1783947799.006569:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1783947799.010183:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783947799.010200:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e7ac66f19c0) 00000020:00000080:2.0:1783947799.010228:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1783947799.014745:0:24997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7be3edb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783947799.014757:0:24997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7be3edb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783947799.014761:0:24997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7be3edb000 3 00010000:00080000:3.0:1783947799.014799:0:24997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bff644800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947799.021176:0:24997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1783947799.021300:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783947799.021382:0:24997:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947799.021398:0:24997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe6fd1fdb55501f76 00000100:00080000:3.0:1783947799.021412:0:24997:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947799.021419:0:24997:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7bff644800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947799.021480:0:24997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d69180 x1870604236220928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947799.021504:0:24997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783947799.021538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947799.021543:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947799.021551:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947799.021555:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 683 00000100:00080000:3.0:1783947799.021558:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783947799.021562:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947799.021578:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d6b480 x1870604236221056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947799.021592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947799.021595:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947799.021597:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947799.021600:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 683 00000100:00080000:3.0:1783947799.021602:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783947799.021606:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947799.021617:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d68380 x1870604236221184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947799.021676:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236221312:0@lo:400:kworker.0 00000100:00100000:3.0:1783947799.021742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.022039:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236220928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947799.022073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.022103:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236221056:0@lo:8:kworker.0 00000100:00100000:2.0:1783947799.022129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.022143:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236221184:0@lo:8:kworker.0 00000100:00100000:2.0:1783947799.022161:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.022201:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221312 00000100:00100000:2.0:1783947799.022207:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221312 00000100:00100000:2.0:1783947799.022244:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236220928 00000100:00100000:2.0:1783947799.022248:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236220928 00000100:00100000:2.0:1783947799.022262:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947799.022270:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236221312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947799.022325:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236221312:12345-0@lo:400:kworker.0 Request processed in 54us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947799.022332:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947799.022347:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947799.022352:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236220928:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783947799.022373:0:22661:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:2.0:1783947799.022401:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe6fd1fdb55501f7d 00000004:00100000:2.0:1783947799.022416:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947799.022508:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9e7ac727b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947799.022549:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870604236220928:12345-0@lo:38:llog_process_th.0 Request processed in 195us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947799.022555:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947799.022578:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221056 00000100:00100000:2.0:1783947799.022583:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221056 00000100:00100000:2.0:1783947799.022599:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221184 00000100:00100000:2.0:1783947799.022602:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221184 00000100:00100000:2.0:1783947799.022617:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947799.022622:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236221056:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783947799.022661:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236221056:12345-0@lo:8:kworker.0 Request processed in 37us (531us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783947799.022668:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947799.022678:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947799.022688:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236221184:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783947799.022718:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236221184:12345-0@lo:8:kworker.0 Request processed in 29us (556us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783947799.022724:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783947799.022769:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d69180 x1870604236220928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947799.022780:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947799.022789:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1783947799.022797:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947799.022802:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783947799.022804:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bff644800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947799.022810:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236220928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947799.022822:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947799.022826:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947799.022829:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783947799.022832:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236221056:0@lo:8:kworker.0 00000100:00100000:2.0:1783947799.022838:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947799.022841:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947799.022843:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783947799.022846:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236221184:0@lo:8:kworker.0 00010000:00080000:2.0:1783947799.022882:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68000 x1870604236221312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947799.022891:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236221312:0@lo:400:kworker.0 00000020:01000004:2.0:1783947799.024835:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783947799.024859:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e7ac66f0000) 00000020:00000080:2.0:1783947799.024885:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783947799.026353:0:24997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7be3edb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783947799.026362:0:24997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7be3edb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783947799.026365:0:24997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7be3edb000 3 00010000:00080000:2.0:1783947799.026416:0:24997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac727f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1783947799.028128:0:24997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1783947799.028242:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1783947799.028291:0:24997:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783947799.028305:0:24997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe6fd1fdb55501f8b 00000100:00080000:2.0:1783947799.028316:0:24997:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947799.028322:0:24997:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e7ac727f000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947799.028357:0:24997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac8620380 x1870604236221440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947799.028396:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236221440:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947799.028487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947799.028547:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221440 00000100:00100000:2.0:1783947799.028553:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221440 00000100:00100000:2.0:1783947799.028584:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947799.028591:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236221440:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783947799.028616:0:22661:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:2.0:1783947799.028647:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe6fd1fdb55501f92 00000004:00100000:2.0:1783947799.028661:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947799.028689:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9e7ac727e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947799.028736:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870604236221440:12345-0@lo:38:llog_process_th.0 Request processed in 144us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947799.028743:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783947799.028791:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac8620380 x1870604236221440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947799.028802:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947799.028809:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1783947799.028815:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947799.028819:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783947799.028821:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac727f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947799.029619:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236221440:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783947799.029643:0:24997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1783947799.030809:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1783947799.033216:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783947799.033268:0:24983:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947799.033292:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f68 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.033304:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9bc00/0xe6fd1fdb55501f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501f68 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783947799.033356:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783947799.033358:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783947799.033363:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947799.033364:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947799.033365:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947799.033367:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947799.033368:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947799.033370:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947799.033371:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947799.033374:0:24983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783947799.033377:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947799.033378:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783947799.033379:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947799.033380:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947799.033380:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947799.033381:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947799.033382:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947799.034548:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947799.034554:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947799.034603:0:24983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783947799.034628:0:24983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236221568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783947799.034709:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947799.034752:0:24983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7738cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947799.035280:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221568 00000100:00100000:2.0:1783947799.035288:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221568 00000100:00100000:2.0:1783947799.035332:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783947799.035341:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236221568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783947799.035368:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783947799.035382:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783947799.039301:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783947799.040147:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783947799.040521:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:24983:x1870604236221568:12345-0@lo:253:mount.lustre.0 Request processed in 5176us (5809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947799.040535:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947799.040770:0:24983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39423f5f-9729-4dc0-9c01-dc528f57ea81:24983:1870604236221568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947799.040784:0:24983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783947799.040795:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947799.040796:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947799.040798:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947799.040799:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947799.040801:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947799.040802:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947799.040803:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947799.040805:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947799.040806:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783947799.040825:0:24983:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783947799.042745:0:22677:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783947799.042753:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783947799.042774:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.042791:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.042799:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.042807:0:22677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.042861:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.042881:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 23 pid: 22655 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947799.042896:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236221696:0@lo:104: 00000100:00100000:3.0:1783947799.042959:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947799.043015:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.043023:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947799.043031:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236221824:0@lo:104: 00000100:00100000:1.0:1783947799.043160:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221696 00000100:00100000:1.0:1783947799.043168:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221696 00000100:00100000:1.0:1783947799.043205:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947799.043213:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236221696:12345-0@lo:104: 00010000:00010000:1.0:1783947799.043226:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045213:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947799.045226:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236221696:12345-0@lo:104: Request processed in 2011us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947799.045237:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1783947799.045275:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947799.045283:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045292:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947799.045297:0:24195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045307:0:24195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947799.045326:0:24195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947799.045332:0:24195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947799.045373:0:24195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045380:0:24195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947799.045403:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045410:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb55501e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501e34 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045422:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947799.045424:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947799.045426:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947799.045448:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236221952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947799.045505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947799.045553:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221952 00000100:00100000:1.0:1783947799.045559:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221952 00010000:00010000:1.0:1783947799.045583:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 24 pid: 22655 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947799.045608:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947799.045615:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3639:x1870604236221952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947799.045628:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947799.045633:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 24 pid: 22655 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045650:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 24 pid: 22655 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.045669:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947799.045703:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3639:x1870604236221952:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947799.045712:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947799.045744:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236221952:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1783947799.047077:0:24983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1783947799.050672:0:24983:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783947799.050683:0:24983:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783947799.050721:0:24983:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947799.050765:0:24983:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947799.050784:0:24983:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1783947799.050800:0:24983:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1783947799.053376:0:24983:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1783947799.053582:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947799.053642:0:22677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7781480 going to sleep for 11 seconds 00010000:00010000:3.0:1783947799.053674:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb55501e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501e2d expref: 23 pid: 22655 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947799.053690:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236221696:0@lo:104: 00000020:00000004:2.0:1783947799.055557:0:24983:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783947799.057564:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236221824 00000100:00100000:3.0:1783947799.057579:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236221824 00000100:00100000:3.0:1783947799.057650:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947799.057660:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236221824:12345-0@lo:104: 00010000:00010000:3.0:1783947799.057679:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947799.057775:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783947799.057781:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:22677:x1870604236221824:12345-0@lo:104: Request processed in 124us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947799.057795:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783947799.059505:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947799.059516:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059526:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ae00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947799.059530:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059539:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947799.059547:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947799.059553:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947799.059594:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059600:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947799.059619:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059642:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ae00/0xe6fd1fdb55501e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501e26 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059659:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947799.059661:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947799.059663:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947799.059686:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236222080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947799.059741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947799.059798:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222080 00000100:00100000:1.0:1783947799.059805:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222080 00010000:00010000:1.0:1783947799.059831:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947799.059859:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947799.059867:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:3640:x1870604236222080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947799.059878:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947799.059882:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059892:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059908:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059916:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947799.059930:0:22646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017177475s 00010000:00010000:1.0:1783947799.059941:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059948:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059955:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059962:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059967:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947799.059971:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.059978:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947799.061504:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb55501e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501e1f expref: 23 pid: 22656 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947799.061522:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22677:1870604236221824:0@lo:104: 00010000:00010000:2.0:1783947799.068294:0:22677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947799.068318:0:22677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947799.068323:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.073274:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.073293:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55501f99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947799.073317:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947799.074998:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:3640:x1870604236222080:12345-0@lo:103:ldlm_bl.0 Request processed in 15112us (15236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947799.075011:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947799.077599:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39423f5f-9729-4dc0-9c01-dc528f57ea81:3640:1870604236222080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947799.476040:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783947800.061071:0:25051:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947800.061718:0:25051:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1783947800.243854:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947800.243870:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be7b4d000 from 14 10000000:01000000:1.0:1783947800.243876:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947800.243929:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947800.243942:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947800.244097:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947800.244129:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947800.244205:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947800.244244:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222208 00000100:00100000:1.0:1783947800.244250:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947800.244253:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222208 00000100:00100000:2.0:1783947800.244302:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783947800.244312:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236222208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947800.244329:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947800.244344:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9ae00/0xe6fd1fdb55501fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501fa0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.244369:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9ae00/0xe6fd1fdb55501fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501fa0 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.244380:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9ae00/0xe6fd1fdb55501fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501fa0 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.244389:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ae00, rc 0) 00000100:00100000:2.0:1783947800.244431:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236222208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947800.244445:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783947800.244925:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3fb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947800.244942:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501fa7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.244951:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501fa7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947800.245032:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783947800.245067:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947800.245098:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac6446840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947800.245111:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222336 00000100:00100000:2.0:1783947800.245115:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222336 00000100:00100000:2.0:1783947800.245140:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783947800.245146:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236222336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783947800.245163:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947800.245178:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947800.245181:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783947800.245258:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236222336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947800.245266:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783947800.245298:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783947800.245367:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947800.245374:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501fa7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245392:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55501fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501fa7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947800.245401:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783947800.245404:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bf7a56000 from 14 10000000:01000000:2.0:1783947800.245407:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783947800.245427:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245436:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245445:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947800.245482:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947800.245511:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947800.245531:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac6446840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947800.245542:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222464 00000100:00100000:2.0:1783947800.245546:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222464 00000100:00100000:2.0:1783947800.245566:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947800.245573:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236222464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947800.245581:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947800.245590:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb55501fb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501fae expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245606:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb55501fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501fae expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245626:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb55501fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501fae expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245634:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:2.0:1783947800.245662:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236222464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947800.245668:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947800.245696:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947800.245708:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501fb5 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.245716:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501fb5 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947800.245752:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783947800.245779:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947800.245791:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac6446840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947800.245801:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222592 00000100:00100000:2.0:1783947800.245805:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222592 00000100:00100000:2.0:1783947800.245823:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783947800.245829:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236222592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783947800.245839:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947800.245850:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947800.245853:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783947800.245909:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236222592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947800.245923:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783947800.245954:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236222592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783947800.246008:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947800.246014:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501fb5 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947800.246021:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb55501fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501fb5 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947800.499820:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947800.756159:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783947801.524447:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947802.549831:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947802.871393:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236222720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947802.871488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947802.871772:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222720 00000100:00100000:0.0:1783947802.871782:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222720 00000100:00100000:0.0:1783947802.871855:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947802.871865:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236222720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947802.871901:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947802.871959:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236222720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947802.871968:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947802.872019:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236222720:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783947802.872152:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783947803.572772:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947803.900802:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947803.900826:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236222848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947803.900914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947803.900973:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222848 00000100:00100000:0.0:1783947803.900981:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222848 00000100:00100000:0.0:1783947803.901027:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947803.901037:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236222848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947803.901075:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947803.901118:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236222848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947803.901125:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947803.901166:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236222848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947803.910742:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236222976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947803.910828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947803.910871:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947803.910879:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236223104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947803.910924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947803.912564:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236222976 00000100:00100000:3.0:1783947803.912578:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236222976 00000100:00100000:3.0:1783947803.912645:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947803.912656:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236222976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947803.912696:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947803.912782:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236222976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947803.912789:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947803.912840:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236222976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947803.922083:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223104 00000100:00100000:2.0:1783947803.922097:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223104 00000100:00100000:2.0:1783947803.922170:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947803.922179:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236223104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947803.922206:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783947803.922291:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236223104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (11365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947803.922298:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947803.925021:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236223104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783947803.929639:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947804.404818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947804.404826:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947804.404829:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947804.404842:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947804.404864:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d69180 x1870604236223360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947804.404919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947804.404923:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947804.404924:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947804.404929:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bc4cba000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947804.404941:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bd9352d80 x1870604236223744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947804.405560:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236223232:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.405659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405704:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236224000:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.405732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405761:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783947804.405766:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236223488:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.405787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405805:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236224128:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.405824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405855:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236223360:0@lo:8:kworker.0 00000100:00100000:3.0:1783947804.405879:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405910:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236223744:0@lo:8:kworker.0 00000100:00100000:3.0:1783947804.405931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405959:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236223616:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.405982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.405998:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236224256:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.406035:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783947804.406039:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236223872:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.406068:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236224384:0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.406114:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223232 00000100:00100000:3.0:1783947804.406121:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223232 00000100:00100000:3.0:1783947804.406167:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783947804.406176:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3637:x1870604236223232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406235:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3637:x1870604236223232:12345-0@lo:400:kworker.0 Request processed in 59us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406242:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783947804.406274:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224000 00000100:00100000:3.0:1783947804.406278:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224000 00000100:00100000:3.0:1783947804.406307:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223488 00000100:00100000:3.0:1783947804.406309:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223488 00000100:00100000:3.0:1783947804.406319:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224128 00000100:00100000:3.0:1783947804.406321:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224128 00000100:00100000:3.0:1783947804.406331:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224256 00000100:00100000:3.0:1783947804.406333:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224256 00000100:00100000:3.0:1783947804.406342:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223872 00000100:00100000:3.0:1783947804.406344:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223872 00000100:00100000:3.0:1783947804.406353:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224384 00000100:00100000:3.0:1783947804.406355:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224384 00000100:00100000:3.0:1783947804.406367:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947804.406509:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236224000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406542:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236224000:12345-0@lo:400:kworker.0 Request processed in 35us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406548:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947804.406561:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947804.406567:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406594:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236223488:12345-0@lo:400:kworker.0 Request processed in 27us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406599:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947804.406610:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947804.406615:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406641:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236224128:12345-0@lo:400:kworker.0 Request processed in 26us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406720:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947804.406733:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947804.406739:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236224256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406773:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236224256:12345-0@lo:400:kworker.0 Request processed in 35us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406779:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947804.406790:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947804.406795:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236223872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406821:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236223872:12345-0@lo:400:kworker.0 Request processed in 26us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406826:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947804.406837:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947804.406843:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236224384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.406866:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236224384:12345-0@lo:400:kworker.0 Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.406871:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947804.406913:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223360 00000100:00100000:3.0:1783947804.406918:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223360 00000100:00100000:3.0:1783947804.406936:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223744 00000100:00100000:3.0:1783947804.406938:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223744 00000100:00100000:3.0:1783947804.406946:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236223616 00000100:00100000:3.0:1783947804.406948:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236223616 00000100:00100000:3.0:1783947804.406966:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947804.406971:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236223616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947804.407013:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236223616:12345-0@lo:400:kworker.0 Request processed in 42us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.407026:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947804.407038:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947804.407041:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236223360:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783947804.407067:0:24167:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1783947804.407093:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501fbc 00002000:00100000:3.0:1783947804.407106:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e7bff646000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783947804.407111:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783947804.407113:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783947804.407273:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783947804.407297:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9e7bff642000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947804.407337:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236223360:12345-0@lo:8:kworker.0 Request processed in 293us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.407344:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947804.407356:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947804.407359:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236223744:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783947804.407373:0:24167:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1783947804.407389:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501fc3 00002000:00100000:3.0:1783947804.407400:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e7bff643800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1783947804.407404:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1783947804.407406:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783947804.407428:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1783947804.407440:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9e7bff640800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947804.407489:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236223744:12345-0@lo:8:kworker.0 Request processed in 128us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.407496:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1783947804.407529:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947804.407533:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947804.407534:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947804.407579:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69180 x1870604236223360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947804.407596:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783947804.407604:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783947804.407610:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783947804.407613:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783947804.407636:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783947804.407642:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236223360:0@lo:8:kworker.0 00010000:00080000:3.0:1783947804.407655:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bd9352d80 x1870604236223744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947804.407664:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1783947804.407669:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783947804.407671:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783947804.407673:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4cba000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783947804.407684:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783947804.407687:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236223744:0@lo:8:kworker.0 00000004:00080000:3.0:1783947804.407719:0:22687:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947804.407780:0:22687:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689635322881ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783947804.407786:0:22687:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1783947804.407808:0:23404:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947804.407845:0:23404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 689635387252ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783947804.407849:0:23404:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1783947804.409873:0:22641:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1783947804.413002:0:22688:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1783947804.413034:0:22688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22688:1870604236224640:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783947804.413100:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947804.413156:0:22688:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783947804.413187:0:23405:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783947804.413202:0:23405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23405:1870604236224896:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1783947804.413225:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947804.413240:0:23405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947804.413438:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236224768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947804.413491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947804.413518:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947804.413524:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236224512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947804.413562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947804.413593:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224768 00000100:00100000:1.0:1783947804.413599:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224768 00000100:00100000:1.0:1783947804.413648:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224512 00000100:00100000:1.0:1783947804.413651:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224512 00000100:00100000:1.0:1783947804.413669:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947804.413677:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236224768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947804.413710:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1783947804.413765:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236224768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947804.413773:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947804.413792:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947804.413799:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236224512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947804.413809:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1783947804.413833:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236224512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947804.413839:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783947804.413857:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947804.413894:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e81f80 x1870604236224512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947804.413914:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236224512:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783947804.413927:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e80700 x1870604236224768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947804.413936:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236224768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947804.415569:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224640 00000100:00100000:2.0:1783947804.415582:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224640 00000100:00100000:2.0:1783947804.415627:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236224896 00000100:00100000:2.0:1783947804.415630:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236224896 00000100:00100000:2.0:1783947804.415647:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947804.415655:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22688:x1870604236224640:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783947804.415951:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947804.415960:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23405:x1870604236224896:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:2.0:1783947804.416042:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bd9352300 x1870604236223872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947804.416056:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236223872:0@lo:400:kworker.0 00010000:00080000:2.0:1783947804.416070:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7df80 x1870604236224384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947804.416079:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236224384:0@lo:400:kworker.0 00000100:00100000:2.0:1783947804.416092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236223616:0@lo:400:kworker.0 00010000:00080000:2.0:1783947804.416102:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bd9351f80 x1870604236224256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947804.416110:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236224256:0@lo:400:kworker.0 00010000:00080000:2.0:1783947804.416151:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68000 x1870604236223488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947804.416161:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236223488:0@lo:400:kworker.0 00010000:00080000:2.0:1783947804.416177:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bd9353800 x1870604236224128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947804.416185:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236224128:0@lo:400:kworker.0 00000100:00100000:2.0:1783947804.416196:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236223232:0@lo:400:kworker.0 00010000:00080000:2.0:1783947804.416209:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bd9353100 x1870604236224000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947804.416216:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236224000:0@lo:400:kworker.0 00000004:00080000:0.0:1783947804.424716:0:23394:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1783947804.434913:0:24170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783947804.434928:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1783947804.434935:0:24170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1783947804.444934:0:24169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783947804.444947:0:24169:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783947804.445060:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23405:x1870604236224896:12345-0@lo:7:osp-pre-1-1.0 Request processed in 29095us (31827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.445083:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783947804.445156:0:23405:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e82680 x1870604236224896/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947820 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947804.445173:0:23405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23405:1870604236224896:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783947804.445190:0:23405:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783947804.445236:0:23405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23405:1870604236225024:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783947804.445268:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.445292:0:23405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7781300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947804.445311:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225024 00000100:00100000:3.0:1783947804.445317:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225024 00000100:00100000:3.0:1783947804.445361:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947804.445370:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23405:x1870604236225024:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783947804.445401:0:24167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1783947804.445433:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23405:x1870604236225024:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.445441:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783947804.445489:0:23405:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7d880 x1870604236225024/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947820 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947804.445500:0:23405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23405:1870604236225024:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783947804.445508:0:23405:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783947804.445533:0:23405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23405:1870604236225152:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783947804.445554:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.445568:0:23405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7781300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947804.445579:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225152 00000100:00100000:3.0:1783947804.445589:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225152 00000100:00100000:3.0:1783947804.445611:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947804.445617:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23405:x1870604236225152:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783947804.445644:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1783947804.474696:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.474708:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474727:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.474732:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.474738:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474900:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474912:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474921:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474942:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947804.474962:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947804.474968:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474976:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.474982:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.474991:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.475011:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.475020:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5ea457/0xe6fd1fdb55501fca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.475041:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.475044:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.475046:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947804.477936:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.477950:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.477968:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.477972:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.477978:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478010:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478020:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478028:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478047:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947804.478058:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947804.478063:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478071:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.478076:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478085:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478100:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478107:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdd26a7e/0xe6fd1fdb55501fd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.478134:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.478136:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.478138:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947804.481154:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.481169:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481187:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.481191:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.481198:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481213:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481223:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481230:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481245:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947804.481848:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.481854:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481875:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.481878:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.481896:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481905:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481913:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481921:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481936:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783947804.481947:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947804.481952:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481961:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.481965:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.481974:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482003:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482011:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501fd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482031:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947804.482034:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482041:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.482045:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482053:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482064:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482071:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501fdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482087:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.482089:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.482098:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783947804.482114:0:24985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1783947804.482136:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783947804.482142:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1783947804.482617:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.482624:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482633:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.482636:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.482641:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482650:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482658:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482665:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.482689:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.482792:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.482799:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.482815:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.482819:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.482828:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.482847:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.482851:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.482870:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb55501fe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.482900:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.482903:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.482904:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947804.485120:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.485132:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.485148:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.485153:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.485159:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.485191:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.485202:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.485210:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.485237:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783947804.486052:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23405:x1870604236225152:12345-0@lo:5:osp-pre-1-1.0 Request processed in 40428us (40489us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783947804.486064:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947804.486700:0:23405:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1783947804.486712:0:23405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23405:1870604236225152:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783947804.486729:0:23405:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1783947804.486783:0:23405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23405:1870604236225280:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783947804.486828:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947804.486913:0:23405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947804.486960:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225280 00000100:00100000:2.0:1783947804.486966:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225280 00000100:00100000:2.0:1783947804.487043:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947804.487053:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23405:x1870604236225280:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783947804.487117:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23405:x1870604236225280:12345-0@lo:900:osp-pre-1-1.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947804.487123:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783947804.487191:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947804.487200:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.487212:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.487216:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.487226:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.487247:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.487255:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501fed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.487280:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.487282:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.487283:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1783947804.487351:0:23405:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e82680 x1870604236225280/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947820 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947804.487361:0:23405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23405:1870604236225280:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1783947804.492195:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.492210:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.492228:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.492233:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.492239:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.492255:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.492266:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.492275:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.492312:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947804.493138:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947804.493148:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493171:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.493176:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493187:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493208:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493215:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000500641d6/0xe6fd1fdb55501ff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493237:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.493239:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.493240:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.493690:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.493697:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493707:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.493712:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.493716:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493727:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493759:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493767:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.493791:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947804.494505:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947804.494513:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.494522:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.494526:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.494534:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.494551:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.494559:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb55501ffb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.494578:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.494580:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.494581:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947804.499664:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.499681:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.499698:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.499710:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.499718:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.499734:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.501263:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.501279:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.501346:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947804.502098:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.502106:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.502120:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.502124:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.502129:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.502141:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.502149:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.502162:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502302:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947804.502310:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502319:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.502323:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502333:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502353:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502360:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a27fbc95/0xe6fd1fdb55502002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502390:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947804.502405:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502413:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.502417:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502423:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502434:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502441:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.502442:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.502444:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.502551:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947804.502557:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed136bbf/0xe6fd1fdb55502009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.502963:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947804.503105:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.503111:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503121:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.503125:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.503129:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503139:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503148:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503155:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503189:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947804.503491:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.503497:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503505:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.503509:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.503513:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503522:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503529:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503536:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503553:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783947804.503562:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947804.503568:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503575:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.503586:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503594:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503607:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503615:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55502010 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503631:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947804.503635:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503641:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.503643:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503649:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503657:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503663:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008828f7f3/0xe6fd1fdb55502017 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.503682:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.503683:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.503685:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.503944:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947804.504210:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.504216:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.504225:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.504228:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.504232:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.504240:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.504248:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.504255:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.504317:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947804.505118:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947804.505126:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.505147:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1783947804.505150:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947804.505155:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.505166:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.505175:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.505182:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505263:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947804.505270:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505277:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ac00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.505281:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505289:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505317:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505326:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c8469e3/0xe6fd1fdb5550201e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505341:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947804.505344:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505351:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.505353:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505360:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505381:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.505388:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.505389:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.505392:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.505596:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783947804.505601:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c7b677/0xe6fd1fdb55502025 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.507692:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.513197:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.513217:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.513263:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.513268:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.513276:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.513293:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.513304:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.513313:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.513352:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947804.513683:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947804.513691:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.513714:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.513718:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.513727:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.513745:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.513754:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb5550202c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.513774:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.513777:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.513779:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.515630:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.515644:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.515660:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.515665:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.515671:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.515685:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.515706:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.515714:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.515737:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947804.516005:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947804.516013:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.516022:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.516026:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.516036:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.516071:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.516088:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502033 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.516107:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.516109:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.516111:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.516894:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.516904:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.516916:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.516919:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.516924:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.516937:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.516945:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.516953:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.516990:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947804.517754:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947804.517763:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.517773:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.517778:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.517804:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.517823:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.517830:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb5550203a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.517850:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.517852:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.517854:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.518775:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.518786:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.518799:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.518803:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.518808:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.518819:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.518828:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.518834:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.518912:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947804.524324:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947804.524343:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.524365:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1783947804.524372:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947804.524380:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.524398:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.524410:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.524418:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.524623:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947804.524633:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.524644:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.524649:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.524659:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.524678:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.524699:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502041 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.524793:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947804.524800:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.524807:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947804.524816:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.524824:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.524834:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.524842:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.524844:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947804.524846:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.524923:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947804.524928:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.524930:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947804.530249:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.530264:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.530282:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.530287:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.530293:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.530307:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.530316:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.530335:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.530362:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947804.530425:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947804.530435:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.530445:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.530450:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.530479:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.530499:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.530506:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b305b0f4/0xe6fd1fdb5550204f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.530541:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.530543:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.530545:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.531075:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.531083:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531093:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.531096:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.531100:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531110:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531119:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531126:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531148:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947804.531609:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947804.531617:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.531626:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947804.531630:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.531638:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.531652:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.531659:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bebfb73/0xe6fd1fdb55502056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947804.531674:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.531676:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947804.531678:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.531803:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.531810:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531824:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.531827:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.531832:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531842:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531851:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531859:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.531899:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947804.532812:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947804.532821:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.532836:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.532841:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.532849:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.532865:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.532873:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335b0dfb/0xe6fd1fdb5550205d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.532900:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.532902:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.532904:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.536615:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.536630:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.536648:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.536653:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.536660:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.536677:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.536701:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.536710:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.536743:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.537302:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.537310:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.537319:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.537330:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.537340:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.537358:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.537366:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003285adf2/0xe6fd1fdb55502064 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.537387:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.537389:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.537391:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.540243:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.540256:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.540272:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.540277:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.540284:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.540297:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.540308:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.540316:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.540366:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.540763:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.540772:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.540781:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.540785:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.540795:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.540812:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.540827:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be97f66a/0xe6fd1fdb5550206b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.540852:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.540854:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.540868:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.543287:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.543303:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.543320:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.543324:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.543330:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.543343:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.543353:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.543371:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.543395:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947804.543690:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947804.543698:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.543707:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947804.543712:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.543721:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.543746:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.543753:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f91be381/0xe6fd1fdb55502072 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947804.543772:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.543774:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947804.543776:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.545222:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.545234:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.545248:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.545264:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.545270:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.545284:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.545293:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.545302:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.545329:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.545591:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.545598:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.545606:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.545610:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.545618:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.545633:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.545640:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a72a882/0xe6fd1fdb55502079 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.545655:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.545657:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.545658:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.547628:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.547641:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.547656:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.547660:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.547666:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.547678:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.547687:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.547707:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.547728:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.548006:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.548014:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.548022:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.548026:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.548036:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.548053:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.548061:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e901f6/0xe6fd1fdb55502080 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.548081:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.548083:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.548085:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.548496:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.548504:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.548514:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.548517:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.548522:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.548532:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.548540:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.548548:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.548566:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.548982:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.548989:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.548998:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.549002:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.549021:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.549035:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.549042:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b01c50/0xe6fd1fdb55502087 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.549058:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.549060:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.549061:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.550097:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.550108:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.550128:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.550132:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.550137:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.550148:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.550157:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.550164:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.550188:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947804.550492:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.550500:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.550509:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.550513:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.550521:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.550534:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.550554:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b153ad3/0xe6fd1fdb5550208e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.550572:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.550574:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.550575:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947804.551609:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.551618:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.551630:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.551635:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.551640:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.551652:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.551674:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.551682:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.551696:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947804.553308:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947804.553321:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.553336:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1783947804.553340:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947804.553345:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.553359:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.553368:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.553376:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947804.553413:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1783947804.553497:0:24170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1783947804.553610:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22688:x1870604236224640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 137951us (140504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947804.553622:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947804.553679:0:22688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22688:1870604236224640:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783947804.553695:0:22688:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1783947804.553740:0:22688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22688:1870604236225408:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783947804.553773:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947804.553795:0:22688:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7d56300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947804.553815:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225408 00000100:00100000:3.0:1783947804.553821:0:24673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225408 00000100:00100000:3.0:1783947804.553891:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947804.553901:0:24673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22688:x1870604236225408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783947804.553939:0:24673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1783947804.558261:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947804.558274:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558289:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.558294:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558306:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558328:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558335:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdbc7146/0xe6fd1fdb55502095 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558362:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947804.558366:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558384:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947804.558387:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558395:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558406:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558412:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d7d11df/0xe6fd1fdb5550209c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947804.558427:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.558429:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.558430:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947804.558438:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947804.579108:0:24673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22688:x1870604236225408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 25202us (25327us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1783947804.579122:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947804.579186:0:22688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22688:1870604236225408:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783947804.579201:0:22688:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1783947804.595635:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783947805.493954:0:25340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783947805.619621:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783947806.425631:0:25393:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947806.425887:0:25393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783947806.643744:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947806.964379:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1783947807.390809:0:25443:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947807.393310:0:25443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947807.668236:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947807.777388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.777515:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094336 00000100:00100000:3.0:1783947807.777528:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094336 00000100:00100000:3.0:1783947807.777585:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:3.0:1783947807.777594:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1870604214094336:12345-192.168.204.3@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783947807.777628:0:22656:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a5eb1973-6d1a-4b8c-987a-a82ce9b8d600@192.168.204.3@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1783947807.777676:0:22656:0:(genops.c:1406:class_connect()) connect: client a5eb1973-6d1a-4b8c-987a-a82ce9b8d600, cookie 0xe6fd1fdb555020a3 00000100:00080000:3.0:1783947807.777813:0:22656:0:(import.c:65:import_set_state_nolock()) ffff9e7bff645000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947807.777903:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+5:2405:x1870604214094336:12345-192.168.204.3@tcp:250:mount.lustre.0 Request processed in 309us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.777912:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:2.0:1783947807.787903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.788036:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094464 00000100:00100000:3.0:1783947807.788051:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094464 00000100:00100000:3.0:1783947807.788135:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:3.0:1783947807.788147:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+5:18116:x1870604214094464:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783947807.788171:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947807.788207:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d50400/0xe6fd1fdb555020aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e444a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947807.788248:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d50400/0xe6fd1fdb555020aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e444a expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947807.788263:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d50400/0xe6fd1fdb555020aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e444a expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947807.788276:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d50400, rc 0) 00000100:00100000:3.0:1783947807.788385:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+6:18116:x1870604214094464:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 240us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.788393:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:1.0:1783947807.796265:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.796532:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094592 00000100:00100000:2.0:1783947807.796547:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094592 00000100:00100000:2.0:1783947807.796634:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:2.0:1783947807.796648:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+6:18116:x1870604214094592:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783947807.796841:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+6:18116:x1870604214094592:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 195us (592us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947807.796851:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:1.0:1783947807.804018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947807.804334:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094720 00000100:00100000:0.0:1783947807.804349:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094720 00000100:00100000:0.0:1783947807.804447:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:0.0:1783947807.804523:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+6:18116:x1870604214094720:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947807.804547:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947807.804573:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51200/0xe6fd1fdb555020b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4451 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947807.804614:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51200/0xe6fd1fdb555020b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4451 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947807.804628:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e51200/0xe6fd1fdb555020b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4451 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947807.804640:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51200, rc 0) 00000100:00100000:0.0:1783947807.804709:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+7:18116:x1870604214094720:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 252us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.804717:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:1.0:1783947807.818612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.818737:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094848 00000100:00100000:3.0:1783947807.818751:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094848 00000100:00100000:3.0:1783947807.818902:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:3.0:1783947807.818915:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+7:18116:x1870604214094848:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783947807.819590:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18116:x1870604214094848:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 673us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.819601:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:1.0:1783947807.828719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.828847:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214094976 00000100:00100000:2.0:1783947807.828864:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214094976 00000100:00100000:2.0:1783947807.829007:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:2.0:1783947807.829021:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18116:x1870604214094976:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947807.829252:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18116:x1870604214094976:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 232us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.829261:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:1.0:1783947807.838333:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947807.846789:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095104 00000100:00100000:0.0:1783947807.846811:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095104 00000100:00100000:0.0:1783947807.846911:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:0.0:1783947807.846923:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18135:x1870604214095104:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947807.847292:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18135:x1870604214095104:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 369us (8979us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.847625:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:1.0:1783947807.882023:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947807.882268:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095232 00000100:00100000:0.0:1783947807.882314:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095232 00000100:00100000:0.0:1783947807.882393:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:0.0:1783947807.882406:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18135:x1870604214095232:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947807.882663:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18135:x1870604214095232:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 259us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.882672:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:3.0:1783947807.886617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.886738:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095360 00000100:00100000:2.0:1783947807.886751:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095360 00000100:00100000:2.0:1783947807.886836:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:2.0:1783947807.886848:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18135:x1870604214095360:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947807.887066:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18135:x1870604214095360:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 219us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.887075:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:1.0:1783947807.896917:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.902228:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095488 00000100:00100000:2.0:1783947807.902252:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095488 00000100:00100000:2.0:1783947807.902437:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:2.0:1783947807.902451:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+8:18116:x1870604214095488:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947807.902495:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947807.902520:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555020b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4482 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947807.902560:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555020b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4482 expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947807.902575:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555020b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4482 expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947807.902586:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a800, rc 0) 00000100:00100000:2.0:1783947807.902676:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+9:18116:x1870604214095488:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 228us (5774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.902684:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1783947807.908639:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947807.908997:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095616 00000100:00100000:0.0:1783947807.909014:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095616 00000100:00100000:0.0:1783947807.909131:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:0.0:1783947807.909144:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+9:18116:x1870604214095616:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783947807.909248:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783947807.909280:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783947807.909284:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783947807.909287:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783947807.909291:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783947807.909293:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1783947807.915328:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+9:18116:x1870604214095616:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 6153us (6670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.915347:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:1.0:1783947807.920601:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.920746:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095744 00000100:00100000:2.0:1783947807.920909:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095744 00000100:00100000:2.0:1783947807.921096:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:2.0:1783947807.921130:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+9:18116:x1870604214095744:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947807.921167:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947807.921193:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4489 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947807.921231:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947807.921245:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947807.921267:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ba00, rc 0) 00000100:00100000:2.0:1783947807.921360:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18116:x1870604214095744:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 235us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.921368:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:1.0:1783947807.923910:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.924437:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214095872 00000100:00100000:3.0:1783947807.924450:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214095872 00000100:00100000:3.0:1783947807.924553:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:3.0:1783947807.924565:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18116:x1870604214095872:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783947807.924800:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18116:x1870604214095872:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 236us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.924809:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:0.0:1783947807.926714:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.926937:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096000 00000100:00100000:2.0:1783947807.926948:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096000 00000100:00100000:2.0:1783947807.927010:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:2.0:1783947807.927022:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c005b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18116:x1870604214096000:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947807.927228:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c005b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18116:x1870604214096000:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 198us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.927238:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:2.0:1783947807.932349:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947807.932793:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096128 00000100:00100000:0.0:1783947807.932807:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096128 00000100:00100000:0.0:1783947807.932886:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:0.0:1783947807.932900:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18142:x1870604214096128:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947807.933132:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18142:x1870604214096128:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 235us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.933147:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:1.0:1783947807.938075:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.938496:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096256 00000100:00100000:2.0:1783947807.938511:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096256 00000100:00100000:2.0:1783947807.938749:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:2.0:1783947807.938762:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18142:x1870604214096256:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947807.939042:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18142:x1870604214096256:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 281us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.939051:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:3.0:1783947807.945542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.945606:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096384 00000100:00100000:2.0:1783947807.945619:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096384 00000100:00100000:2.0:1783947807.945756:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947807.945770:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1870604214096384:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783947807.945811:0:22663:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f708495a-69fd-4413-8caa-ba048b1b3556@192.168.204.3@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1783947807.945893:0:22663:0:(genops.c:1406:class_connect()) connect: client f708495a-69fd-4413-8caa-ba048b1b3556, cookie 0xe6fd1fdb555020c6 00000004:00100000:2.0:1783947807.945927:0:22663:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783947807.946173:0:22663:0:(import.c:65:import_set_state_nolock()) ffff9e7ac727e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947807.946271:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+6:2405:x1870604214096384:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 501us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947807.946279:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1783947807.951709:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947807.952145:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.953168:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096640 00000100:00100000:3.0:1783947807.953183:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096640 00000100:00100000:1.0:1783947807.953207:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947807.953545:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096512 00000100:00100000:2.0:1783947807.953551:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096512 00000100:00080000:1.0:1783947807.953644:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947807.953859:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096896 00000100:00100000:0.0:1783947807.953864:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096896 00000100:00100000:0.0:1783947807.953902:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947807.954282:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:0:x1870604214096512:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947807.954359:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783947807.954495:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:0:x1870604214096512:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 218us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.956062:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:3.0:1783947807.956190:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:3.0:1783947807.956209:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214096896:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783947807.956253:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947807.956337:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214096896:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 136us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.956346:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:3.0:1783947807.956365:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:3.0:1783947807.956370:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1870604214096640:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783947807.956419:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from f708495a-69fd-4413-8caa-ba048b1b3556@192.168.204.3@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1783947807.956532:0:22662:0:(genops.c:1406:class_connect()) connect: client f708495a-69fd-4413-8caa-ba048b1b3556, cookie 0xe6fd1fdb555020cd 00000004:00100000:3.0:1783947807.956568:0:22662:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783947807.956924:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9e7bff645800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947807.957016:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:2405:x1870604214096640:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 644us (5323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947807.957024:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:3.0:1783947807.959051:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947807.964123:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.964512:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097024 00000100:00100000:3.0:1783947807.964527:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097024 00000100:00100000:3.0:1783947807.964661:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214096768 00000100:00100000:3.0:1783947807.964665:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214096768 00000100:00100000:0.0:1783947807.964782:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947807.964800:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214097024:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783947807.964958:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214097024:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 154us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.964968:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00080000:1.0:1783947807.964991:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947807.965000:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1783947807.965010:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:0:x1870604214096768:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947807.965045:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947807.965109:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:0:x1870604214096768:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 100us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.965117:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1783947807.970291:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.970524:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947807.970551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947807.970608:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097408 00000100:00100000:0.0:1783947807.970621:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097408 00000100:00100000:0.0:1783947807.970713:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:0.0:1783947807.970728:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214097408:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783947807.970867:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214097408:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 142us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.970876:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947807.975484:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097152 00000100:00100000:2.0:1783947807.975505:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097152 00000100:00100000:1.0:1783947807.975528:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097280 00000100:00100000:1.0:1783947807.975536:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097280 00000100:00100000:1.0:1783947807.975620:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1783947807.975631:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1870604214097280:12345-192.168.204.3@tcp:8:mount.lustre.0 00000100:00100000:0.0:1783947807.975738:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1783947807.975766:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604214097152:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783947807.975786:0:24169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f708495a-69fd-4413-8caa-ba048b1b3556@192.168.204.3@tcp t0 exp 0000000000000000 cur 693 last 0 00010000:00080000:1.0:1783947807.975827:0:24170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f708495a-69fd-4413-8caa-ba048b1b3556@192.168.204.3@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1783947807.975861:0:24170:0:(genops.c:1406:class_connect()) connect: client f708495a-69fd-4413-8caa-ba048b1b3556, cookie 0xe6fd1fdb555020db 00002000:00100000:1.0:1783947807.975877:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f708495a-69fd-4413-8caa-ba048b1b3556/ffff9e7bc5373800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:0.0:1783947807.975894:0:24169:0:(genops.c:1406:class_connect()) connect: client f708495a-69fd-4413-8caa-ba048b1b3556, cookie 0xe6fd1fdb555020d4 00002000:00100000:1.0:1783947807.975901:0:24170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1783947807.975903:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f708495a-69fd-4413-8caa-ba048b1b3556/ffff9e7be3edf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947807.975920:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783947807.976135:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1783947807.976188:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783947807.976194:0:24170:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783947807.976211:0:24169:0:(import.c:65:import_set_state_nolock()) ffff9e7be3edf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947807.976622:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:2405:x1870604214097152:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 854us (6345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947807.976632:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1783947807.976640:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+6:2405:x1870604214097280:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 1008us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947807.976648:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:2.0:1783947807.978759:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947807.978949:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097536 00000100:00100000:1.0:1783947807.978961:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097536 00000100:00100000:1.0:1783947807.979037:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1783947807.979049:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214097536:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783947807.981472:0:22664:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2254us 00000100:00100000:2.0:1783947807.991235:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236225536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947807.991343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947807.991397:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225536 00000100:00100000:1.0:1783947807.991408:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225536 00000100:00100000:1.0:1783947807.991534:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947807.991548:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236225536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947807.991583:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947807.991652:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236225536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947807.991660:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1783947807.991688:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947807.992350:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236225536:0@lo:13:osp-pre-0-1.0 00000004:00200000:1.0:1783947808.010662:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783947808.011165:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18116:x1870604214097536:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 32109us (32411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947808.011180:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1783947808.223913:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947808.225157:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097664 00000100:00100000:0.0:1783947808.225178:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097664 00000100:00100000:0.0:1783947808.225568:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1783947808.225586:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:18165:x1870604214097664:12345-192.168.204.3@tcp:101:mkdir.0 00010000:00010000:0.0:1783947808.225618:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947808.225731:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555020e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e44ba expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947808.225838:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555020e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947808.225855:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555020e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947808.225874:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555020e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947808.227849:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947808.227864:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947808.227963:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555020e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947808.229172:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555020e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44ba expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947808.229888:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555020e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44ba expref: 7 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947808.229908:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:0.0:1783947808.229911:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947808.229916:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50800, rc 0) 00000100:00100000:0.0:1783947808.230055:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:18165:x1870604214097664:12345-192.168.204.3@tcp:101:mkdir.0 Request processed in 4470us (6157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947808.230067:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00010000:00010000:3.0:1783947808.691884:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947809.012482:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947809.012517:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236225664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947809.012624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947809.012754:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225664 00000100:00100000:2.0:1783947809.012764:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225664 00000100:00100000:2.0:1783947809.012842:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783947809.012853:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236225664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947809.012902:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947809.013038:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236225664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947809.013047:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947809.014025:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947809.014046:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236225792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947809.014111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947809.014177:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225792 00000100:00100000:0.0:1783947809.014185:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225792 00000100:00100000:0.0:1783947809.014233:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947809.014242:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236225792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947809.014311:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783947809.014359:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236225792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947809.014367:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947809.014418:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236225792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947809.015028:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947809.015043:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236225920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947809.015095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947809.016338:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236225920 00000100:00100000:2.0:1783947809.016354:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236225920 00000100:00100000:2.0:1783947809.016491:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947809.016502:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236225920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947809.016537:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783947809.016621:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236225920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947809.016630:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783947809.017005:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947809.017067:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236225920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947809.017312:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236225664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947809.523838:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947809.523870:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236226048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947809.524002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947809.524071:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226048 00000100:00100000:1.0:1783947809.524082:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226048 00000100:00100000:1.0:1783947809.524268:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947809.524283:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870604236226048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947809.524328:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1783947809.524392:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870604236226048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947809.524401:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1783947809.524431:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947809.524514:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236226048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947809.524824:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947809.524839:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236226176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947809.524876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947809.525014:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226176 00000100:00100000:0.0:1783947809.525020:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226176 00000100:00100000:0.0:1783947809.525062:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947809.525070:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236226176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947809.525085:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1783947809.525135:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236226176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947809.525142:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947809.526321:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236226432:0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947809.526404:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236226944:0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947809.526449:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783947809.526487:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236226304:0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947809.526552:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236226816:0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947809.526609:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226432 00000100:00100000:2.0:1783947809.526616:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226432 00000100:00100000:2.0:1783947809.526652:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226944 00000100:00100000:2.0:1783947809.526655:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226944 00000100:00100000:2.0:1783947809.526673:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226816 00000100:00100000:2.0:1783947809.526675:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226816 00000100:00100000:2.0:1783947809.526690:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947809.526696:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236226432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526767:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236226432:12345-0@lo:400:kworker.0 Request processed in 69us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947809.526776:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947809.526808:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947809.526815:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236226944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526847:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236226944:12345-0@lo:400:kworker.0 Request processed in 33us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947809.526854:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947809.526866:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947809.526873:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236226816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526909:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236226816:12345-0@lo:400:kworker.0 Request processed in 37us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947809.526916:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947809.526979:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236226816:0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.526993:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236226432:0@lo:400:kworker.0 00010000:00080000:2.0:1783947809.527006:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5843480 x1870604236226944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947809.527018:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236226944:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.527478:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236226688:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.527519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947809.527545:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236227200:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.527578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947809.527597:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783947809.527603:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236226560:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.527632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947809.527649:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236227072:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.527674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947809.527758:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226560 00000100:00100000:3.0:1783947809.527772:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226560 00000100:00100000:3.0:1783947809.527837:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947809.527846:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236226560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947809.527908:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236226560:12345-0@lo:400:kworker.0 Request processed in 63us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947809.527915:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783947809.527938:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947809.527944:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947809.527947:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947809.527949:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947809.527993:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236226176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947809.528253:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226304 00000100:00100000:0.0:1783947809.528259:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226304 00000100:00100000:0.0:1783947809.528305:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947809.528312:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3638:x1870604236226304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947809.528355:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3638:x1870604236226304:12345-0@lo:400:kworker.0 Request processed in 44us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947809.528361:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947809.528393:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236226688 00000100:00100000:0.0:1783947809.528397:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236226688 00000100:00100000:0.0:1783947809.528413:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227200 00000100:00100000:0.0:1783947809.528416:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227200 00000100:00100000:0.0:1783947809.528438:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227072 00000100:00100000:0.0:1783947809.528440:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227072 00000100:00100000:0.0:1783947809.528478:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947809.528495:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947809.528526:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236226688:12345-0@lo:400:kworker.0 Request processed in 33us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947809.528533:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947809.528544:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783947809.528550:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236227200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947809.528577:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236227200:12345-0@lo:400:kworker.0 Request processed in 28us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947809.528582:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783947809.528593:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947809.528599:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236227072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947809.528625:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236227072:12345-0@lo:400:kworker.0 Request processed in 26us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947809.528631:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1783947809.528646:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947809.528649:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947809.528980:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236226560:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.528992:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236227072:0@lo:400:kworker.0 00000100:00100000:1.0:1783947809.529003:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236226688:0@lo:400:kworker.0 00010000:00080000:1.0:1783947809.529015:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5840700 x1870604236227200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947809.529034:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236227200:0@lo:400:kworker.0 00000100:00100000:2.0:1783947809.530292:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236226304:0@lo:400:kworker.0 00010000:00010000:3.0:1783947809.716198:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947810.186206:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.195605:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097792 00000100:00100000:0.0:1783947810.195628:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097792 00000100:00100000:0.0:1783947810.195784:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1783947810.195801:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:18217:x1870604214097792:12345-192.168.204.3@tcp:41:lfs.0 00000004:00000024:0.0:1783947810.195860:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783947810.195999:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:18217:x1870604214097792:12345-192.168.204.3@tcp:41:lfs.0 Request processed in 203us (9812us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.196008:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00080000:3.0:1783947810.196591:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947810.198827:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.200092:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214097920 00000100:00100000:0.0:1783947810.200111:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214097920 00000100:00080000:3.0:1783947810.200220:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947810.200385:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:0.0:1783947810.200404:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+6:18217:x1870604214097920:12345-192.168.204.3@tcp:41:lfs.0 00000004:00000024:0.0:1783947810.200501:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947810.200645:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+6:18217:x1870604214097920:12345-192.168.204.3@tcp:41:lfs.0 Request processed in 247us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.200654:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1783947810.203924:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.208482:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098048 00000100:00100000:0.0:1783947810.208507:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098048 00000100:00080000:3.0:1783947810.209682:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947810.209823:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1783947810.209843:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f708495a-69fd-4413-8caa-ba048b1b3556+6:18217:x1870604214098048:12345-192.168.204.3@tcp:13:lfs.0 00002000:00000024:1.0:1783947810.209888:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947810.210045:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f708495a-69fd-4413-8caa-ba048b1b3556+6:18217:x1870604214098048:12345-192.168.204.3@tcp:13:lfs.0 Request processed in 210us (6149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947810.210055:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947810.215724:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947810.215932:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098176 00000100:00100000:2.0:1783947810.220387:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098176 00000100:00100000:2.0:1783947810.220574:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:2.0:1783947810.220589:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f708495a-69fd-4413-8caa-ba048b1b3556+6:18217:x1870604214098176:12345-192.168.204.3@tcp:13:lfs.0 00002000:00000024:2.0:1783947810.220668:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1783947810.220967:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947810.221572:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f708495a-69fd-4413-8caa-ba048b1b3556+6:18217:x1870604214098176:12345-192.168.204.3@tcp:13:lfs.0 Request processed in 979us (5857us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947810.221584:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:2.0:1783947810.457416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.457570:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098304 00000100:00100000:3.0:1783947810.457585:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098304 00000100:00100000:3.0:1783947810.457664:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:3.0:1783947810.457677:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+10:18249:x1870604214098304:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783947810.457701:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947810.457728:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d51e00/0xe6fd1fdb555020f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e44c1 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.457867:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d51e00/0xe6fd1fdb555020f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44c1 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.457883:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d51e00/0xe6fd1fdb555020f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44c1 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.457916:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51e00, rc 0) 00000100:00100000:3.0:1783947810.458055:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18249:x1870604214098304:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 380us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.458063:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:3.0:1783947810.488953:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.489148:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098432 00000100:00100000:0.0:1783947810.489161:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098432 00000100:00100000:0.0:1783947810.489230:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:0.0:1783947810.489241:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18249:x1870604214098432:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783947810.489539:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18249:x1870604214098432:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 298us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.489550:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:1.0:1783947810.510198:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.510631:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098560 00000100:00100000:0.0:1783947810.510647:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098560 00000100:00100000:0.0:1783947810.510732:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:0.0:1783947810.510744:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18249:x1870604214098560:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783947810.511005:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18249:x1870604214098560:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 260us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.511015:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:2.0:1783947810.517374:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.518304:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098688 00000100:00100000:3.0:1783947810.518322:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098688 00000100:00100000:3.0:1783947810.518414:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:3.0:1783947810.518438:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18256:x1870604214098688:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947810.518745:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18256:x1870604214098688:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 309us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.518754:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:1.0:1783947810.544667:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.544936:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098816 00000100:00100000:3.0:1783947810.544952:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098816 00000100:00100000:3.0:1783947810.545028:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:3.0:1783947810.545041:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18256:x1870604214098816:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947810.545941:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18256:x1870604214098816:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 893us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.545954:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 135 00000001:00100000:0.0:1783947810.552573:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f708495a-69fd-4413-8caa-ba048b1b3556 00000001:00080000:0.0:1783947810.552608:0:24985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:1.0:1783947810.567617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.572111:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214098944 00000100:00100000:3.0:1783947810.572133:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214098944 00000100:00100000:3.0:1783947810.574474:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:3.0:1783947810.574519:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18256:x1870604214098944:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947810.574988:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18256:x1870604214098944:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 269us (7158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.575007:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:2.0:1783947810.580623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.580972:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099072 00000100:00100000:3.0:1783947810.580987:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099072 00000100:00100000:3.0:1783947810.581070:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:3.0:1783947810.581084:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18249:x1870604214099072:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783947810.581110:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947810.581136:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d50000/0xe6fd1fdb555020f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e44f2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.581177:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d50000/0xe6fd1fdb555020f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f2 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.581190:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d50000/0xe6fd1fdb555020f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f2 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.581201:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d50000, rc 0) 00000100:00100000:3.0:1783947810.582062:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18249:x1870604214099072:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 969us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.582075:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:1.0:1783947810.591129:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947810.595892:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099200 00000100:00100000:2.0:1783947810.595917:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099200 00000100:00100000:0.0:1783947810.596128:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:0.0:1783947810.596173:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18249:x1870604214099200:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783947810.596212:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783947810.596239:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783947810.596244:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783947810.596259:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783947810.596263:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783947810.596265:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1783947810.602999:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18249:x1870604214099200:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 6816us (11869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.603021:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:1.0:1783947810.615145:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.615540:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099328 00000100:00100000:3.0:1783947810.615556:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099328 00000100:00100000:3.0:1783947810.615636:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:3.0:1783947810.615658:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18249:x1870604214099328:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783947810.615684:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947810.615712:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e44f9 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.615784:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.615798:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.615813:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51a00, rc 0) 00000100:00100000:3.0:1783947810.615892:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18249:x1870604214099328:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 238us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.615900:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:1.0:1783947810.621053:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.623581:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099456 00000100:00100000:0.0:1783947810.623608:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099456 00000100:00100000:0.0:1783947810.623719:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:0.0:1783947810.624306:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18249:x1870604214099456:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783947810.624638:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18249:x1870604214099456:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 908us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.624648:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:1.0:1783947810.632675:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947810.632797:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099584 00000100:00100000:2.0:1783947810.632811:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099584 00000100:00100000:2.0:1783947810.632900:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:2.0:1783947810.632913:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18249:x1870604214099584:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947810.633142:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18249:x1870604214099584:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 232us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947810.633151:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:1.0:1783947810.636312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.636861:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099712 00000100:00100000:0.0:1783947810.636875:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099712 00000100:00100000:0.0:1783947810.636960:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:0.0:1783947810.636970:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18263:x1870604214099712:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947810.637177:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18263:x1870604214099712:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 207us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.637184:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:1.0:1783947810.648620:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.648746:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099840 00000100:00100000:3.0:1783947810.648760:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099840 00000100:00100000:3.0:1783947810.648843:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:3.0:1783947810.648856:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18263:x1870604214099840:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947810.649072:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18263:x1870604214099840:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 219us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.649081:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:1.0:1783947810.672298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947810.672352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947810.672565:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214099968 00000100:00100000:2.0:1783947810.672579:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214099968 00000100:00100000:2.0:1783947810.672634:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100224 00000100:00100000:2.0:1783947810.672637:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100224 00000100:00100000:2.0:1783947810.672655:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1783947810.672664:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1870604214099968:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783947810.672706:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4aec5925-d4b7-4c93-a83c-72b2db0b1155@192.168.204.3@tcp t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:2.0:1783947810.672778:0:22662:0:(genops.c:1406:class_connect()) connect: client 4aec5925-d4b7-4c93-a83c-72b2db0b1155, cookie 0xe6fd1fdb55502105 00000004:00100000:2.0:1783947810.672815:0:22662:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783947810.672950:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9e7ac727d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947810.673079:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2405:x1870604214099968:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 414us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947810.673089:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1783947810.673112:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:2.0:1783947810.673117:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1870604214100224:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783947810.673134:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 4aec5925-d4b7-4c93-a83c-72b2db0b1155@192.168.204.3@tcp t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:2.0:1783947810.673164:0:22662:0:(genops.c:1406:class_connect()) connect: client 4aec5925-d4b7-4c93-a83c-72b2db0b1155, cookie 0xe6fd1fdb5550210c 00000004:00100000:2.0:1783947810.673179:0:22662:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783947810.673233:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9e7ac727a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947810.673257:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2405:x1870604214100224:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 139us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947810.673264:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1783947810.677811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947810.677855:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947810.677888:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947810.677992:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100352 00000100:00100000:0.0:1783947810.677993:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100096 00000100:00100000:0.0:1783947810.678007:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100096 00000100:00100000:2.0:1783947810.678008:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100352 00000100:00100000:3.0:1783947810.678077:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100480 00000100:00100000:3.0:1783947810.678092:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100480 00000100:00100000:2.0:1783947810.678114:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1783947810.678174:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:0:x1870604214100352:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783947810.678217:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947810.678308:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:0:x1870604214100352:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 138us (512us total) trans 0 rc 0/0 00000100:00080000:1.0:1783947810.681485:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947810.681500:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947810.683974:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:0.0:1783947810.684039:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1783947810.684068:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:18249:x1870604214100480:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947810.684122:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783947810.684221:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:18249:x1870604214100480:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 171us (6331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.684229:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1783947810.684947:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1783947810.684969:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:0:x1870604214100096:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783947810.685001:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783947810.685045:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:0:x1870604214100096:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 87us (7189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.685053:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1783947810.691736:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.692974:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100608 00000100:00100000:0.0:1783947810.692994:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100608 00000100:00100000:0.0:1783947810.693096:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1783947810.693109:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18249:x1870604214100608:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783947810.693246:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18249:x1870604214100608:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 139us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.693256:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1783947810.702831:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.702961:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100736 00000100:00100000:2.0:1783947810.702968:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.702977:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100736 00000100:00100000:2.0:1783947810.703012:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947810.703027:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100864 00000100:00100000:0.0:1783947810.703031:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100864 00000100:00100000:2.0:1783947810.703047:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214100992 00000100:00100000:2.0:1783947810.703053:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214100992 00000100:00100000:0.0:1783947810.703060:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1783947810.703071:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604214100736:12345-192.168.204.3@tcp:8:mount.lustre.0 00000100:00100000:2.0:1783947810.703101:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:2.0:1783947810.703111:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18249:x1870604214100992:12345-192.168.204.3@tcp:900:mount.lustre.0 00010000:00080000:0.0:1783947810.703117:0:24169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4aec5925-d4b7-4c93-a83c-72b2db0b1155@192.168.204.3@tcp t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:0.0:1783947810.703162:0:24169:0:(genops.c:1406:class_connect()) connect: client 4aec5925-d4b7-4c93-a83c-72b2db0b1155, cookie 0xe6fd1fdb55502113 00002000:00100000:0.0:1783947810.703179:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4aec5925-d4b7-4c93-a83c-72b2db0b1155/ffff9e7bd1b6b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947810.703195:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783947810.703223:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18249:x1870604214100992:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 113us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947810.703231:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00002000:00080000:0.0:1783947810.703288:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783947810.703340:0:24169:0:(import.c:65:import_set_state_nolock()) ffff9e7bf7ef1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947810.703379:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2405:x1870604214100736:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 310us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.703387:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1783947810.703403:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:0.0:1783947810.703408:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604214100864:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783947810.703426:0:24169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4aec5925-d4b7-4c93-a83c-72b2db0b1155@192.168.204.3@tcp t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:0.0:1783947810.703443:0:24169:0:(genops.c:1406:class_connect()) connect: client 4aec5925-d4b7-4c93-a83c-72b2db0b1155, cookie 0xe6fd1fdb5550211a 00002000:00100000:0.0:1783947810.703448:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4aec5925-d4b7-4c93-a83c-72b2db0b1155/ffff9e7bf7ef6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947810.703479:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783947810.703533:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783947810.703547:0:24169:0:(import.c:65:import_set_state_nolock()) ffff9e7bf7ef6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947810.703567:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2405:x1870604214100864:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 158us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947810.703574:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947810.710318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947810.710725:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101120 00000100:00100000:2.0:1783947810.710740:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101120 00000100:00100000:2.0:1783947810.710864:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947810.710876:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18249:x1870604214101120:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783947810.711021:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783947810.711183:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18249:x1870604214101120:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 308us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947810.711192:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00010000:00010000:1.0:1783947810.739741:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947810.885575:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947810.885716:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101248 00000100:00100000:3.0:1783947810.885733:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101248 00000100:00100000:3.0:1783947810.885853:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1783947810.885867:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18285:x1870604214101248:12345-192.168.204.3@tcp:101:mkdir.0 00010000:00010000:3.0:1783947810.885972:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947810.886010:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51800/0xe6fd1fdb55502121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e452a expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.886103:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.886121:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.886138:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947810.886204:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947810.886208:0:22663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947810.886236:0:22663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.886690:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51800/0xe6fd1fdb55502121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 8 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.886713:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 7 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947810.886723:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:3.0:1783947810.886744:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947810.886749:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51600, rc 0) 00000100:00100000:3.0:1783947810.886911:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:18285:x1870604214101248:12345-192.168.204.3@tcp:101:mkdir.0 Request processed in 1045us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947810.886921:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000040:00080000:1.0:1783947810.996493:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947811.764341:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947812.787681:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947813.109488:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236227328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947813.111110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947813.111916:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227328 00000100:00100000:3.0:1783947813.111928:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227328 00000100:00100000:3.0:1783947813.112005:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947813.112018:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236227328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947813.112063:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947813.112137:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236227328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947813.112145:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783947813.112489:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947813.112667:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236227328:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1783947813.623043:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4aec5925-d4b7-4c93-a83c-72b2db0b1155 00000001:00100000:1.0:1783947813.623063:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f708495a-69fd-4413-8caa-ba048b1b3556 00000001:00100000:3.0:1783947813.625032:0:22641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4aec5925-d4b7-4c93-a83c-72b2db0b1155 00000001:00100000:3.0:1783947813.625048:0:22641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f708495a-69fd-4413-8caa-ba048b1b3556 00000001:00100000:1.0:1783947813.630997:0:23394:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4aec5925-d4b7-4c93-a83c-72b2db0b1155 00000001:00100000:1.0:1783947813.631014:0:23394:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f708495a-69fd-4413-8caa-ba048b1b3556 00010000:00010000:1.0:1783947813.811920:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783947814.040878:0:25541:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783947814.138987:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236227456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947814.139093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.139188:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236227584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947814.139218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.139262:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227456 00000100:00100000:1.0:1783947814.139272:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227456 00000100:00100000:1.0:1783947814.139326:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227584 00000100:00100000:1.0:1783947814.139330:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227584 00000100:00100000:1.0:1783947814.139350:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947814.139358:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236227456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947814.139404:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783947814.139479:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236227456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947814.139487:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947814.139508:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947814.139515:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236227584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947814.139535:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783947814.139574:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236227584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947814.139601:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947814.139656:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236227584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947814.139713:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236227456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947814.142107:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236227712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947814.142195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.142269:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227712 00000100:00100000:1.0:1783947814.142277:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227712 00000100:00100000:1.0:1783947814.142359:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947814.142370:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236227712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947814.142400:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947814.142449:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236227712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947814.142476:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947814.142540:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236227712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783947814.142671:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947814.643938:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236227840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947814.644502:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236227968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947814.644683:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236228096:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.646819:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947814.647002:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236228480:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.647043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947814.647067:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236228992:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.647091:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947814.647111:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783947814.647118:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236228352:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.647150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947814.647169:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236228864:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.647802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947814.647927:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228992 00000100:00100000:2.0:1783947814.647936:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228992 00000100:00100000:2.0:1783947814.647986:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228352 00000100:00100000:2.0:1783947814.647989:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228352 00000100:00100000:2.0:1783947814.648003:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228864 00000100:00100000:2.0:1783947814.648006:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228864 00000100:00100000:2.0:1783947814.648024:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947814.648032:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236228992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.648095:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236228992:12345-0@lo:400:kworker.0 Request processed in 64us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.648103:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947814.648120:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947814.648126:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236228352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.648287:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236228352:12345-0@lo:400:kworker.0 Request processed in 160us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.648293:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947814.648306:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947814.648312:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236228864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.648338:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236228864:12345-0@lo:400:kworker.0 Request processed in 26us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.648343:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783947814.648363:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947814.648367:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947814.648412:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236228352:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.648424:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236228864:0@lo:400:kworker.0 00010000:00080000:2.0:1783947814.648436:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7fd2680 x1870604236228992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947814.648479:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236228992:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.648542:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228480 00000100:00100000:2.0:1783947814.648546:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228480 00000100:00100000:2.0:1783947814.648745:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947814.648753:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236228480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.648796:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236228480:12345-0@lo:400:kworker.0 Request processed in 44us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.648802:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947814.648933:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236228480:0@lo:400:kworker.0 00000100:00100000:3.0:1783947814.649342:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227968 00000100:00100000:3.0:1783947814.649347:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227968 00000100:00100000:3.0:1783947814.649385:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947814.649392:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236227968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947814.649488:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1783947814.649534:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236227968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947814.649540:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783947814.649559:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947814.651546:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236228224:0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.652555:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236227968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947814.652821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.652867:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236228736:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.652895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.652912:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236229248:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.652931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.652972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.653001:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236228608:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.653037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947814.653060:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236229120:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.653081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947814.653325:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228224 00000100:00100000:2.0:1783947814.653332:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228224 00000100:00100000:2.0:1783947814.653385:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228608 00000100:00100000:2.0:1783947814.653388:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228608 00000100:00100000:2.0:1783947814.653410:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947814.653418:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236228224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.653496:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236228224:12345-0@lo:400:kworker.0 Request processed in 78us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.653503:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947814.653520:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947814.653526:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236228608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.653555:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236228608:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.653561:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947814.653579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947814.653659:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228736 00000100:00100000:0.0:1783947814.653663:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228736 00000100:00100000:0.0:1783947814.653682:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236229248 00000100:00100000:2.0:1783947814.653683:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236228096 00000100:00100000:2.0:1783947814.653695:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236228096 00000100:00100000:0.0:1783947814.653695:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236229248 00000100:00100000:0.0:1783947814.653709:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236229120 00000100:00100000:0.0:1783947814.653712:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236229120 00000100:00100000:2.0:1783947814.653717:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783947814.653722:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3639:x1870604236228096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947814.653733:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947814.653739:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236228736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.653751:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3639:x1870604236228096:12345-0@lo:400:kworker.0 Request processed in 29us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947814.653758:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783947814.653764:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236228736:12345-0@lo:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947814.653769:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947814.653781:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783947814.653785:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783947814.653786:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236229248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.653790:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236229120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947814.653812:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236229120:12345-0@lo:400:kworker.0 Request processed in 22us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947814.653812:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236229248:12345-0@lo:400:kworker.0 Request processed in 25us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947814.653818:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947814.653882:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1783947814.653898:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236228224:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.653909:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236228736:0@lo:400:kworker.0 00010000:00080000:1.0:1783947814.653921:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7fd2300 x1870604236229248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947814.653933:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236229248:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.653971:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236228096:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.653980:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236228608:0@lo:400:kworker.0 00000100:00100000:1.0:1783947814.653990:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236229120:0@lo:400:kworker.0 00000100:00080000:3.0:1783947814.654906:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947814.654912:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947814.654916:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947814.654941:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236227840 00000100:00100000:3.0:1783947814.654947:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236227840 00000100:00100000:3.0:1783947814.654999:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947814.655008:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236227840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947814.655030:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1783947814.655099:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236227840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947814.655107:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947814.655373:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236227840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947814.655522:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1783947814.836470:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947815.859599:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947815.916737:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947815.916812:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101376 00000100:00100000:1.0:1783947815.916827:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101376 00000100:00100000:1.0:1783947815.916903:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:1.0:1783947815.916914:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:2406:x1870604214101376:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947815.916996:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:2406:x1870604214101376:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947815.917004:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:2.0:1783947815.917555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947815.917676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947815.917701:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947815.917723:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947815.917746:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947815.918844:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101632 00000100:00100000:1.0:1783947815.918857:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101632 00000100:00100000:1.0:1783947815.918914:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102144 00000100:00100000:1.0:1783947815.918917:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102144 00000100:00100000:1.0:1783947815.918949:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101504 00000100:00100000:1.0:1783947815.918951:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101504 00000100:00100000:1.0:1783947815.918968:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:1.0:1783947815.918977:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214101632:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947815.919039:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947815.923236:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214101632:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 4247us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947815.923251:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:1.0:1783947815.923294:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:1.0:1783947815.923311:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2406:x1870604214102144:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:3.0:1783947815.926321:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947815.926333:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947815.927705:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947815.927755:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947815.927799:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101888 00000100:00100000:0.0:1783947815.927811:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101888 00000100:00100000:0.0:1783947815.927868:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102400 00000100:00100000:0.0:1783947815.927872:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102400 00000100:00100000:0.0:1783947815.927887:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214101760 00000100:00100000:0.0:1783947815.927890:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214101760 00000100:00100000:0.0:1783947815.927903:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102272 00000100:00100000:0.0:1783947815.927905:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102272 00000100:00100000:0.0:1783947815.927922:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947815.927933:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214101888:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947815.928093:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214101888:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 158us (10413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947815.928103:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947815.928134:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947815.928164:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2406:x1870604214102400:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947815.928206:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2406:x1870604214102400:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (10480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947815.928214:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947815.928235:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947815.928245:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214101760:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947815.928282:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214101760:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 38us (10513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947815.928290:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947815.928308:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:0.0:1783947815.928319:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2406:x1870604214102272:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947815.928359:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2406:x1870604214102272:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947815.928367:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1783947815.928827:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2406:x1870604214102144:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 5523us (11122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947815.928838:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:1.0:1783947815.928860:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102016 00000100:00100000:1.0:1783947815.928865:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102016 00000100:00100000:1.0:1783947815.928902:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:1.0:1783947815.928911:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:2406:x1870604214101504:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:3.0:1783947815.928919:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947815.928931:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947815.928937:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947815.928959:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:2406:x1870604214101504:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (11202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947815.928973:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:1.0:1783947815.928988:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:1.0:1783947815.928993:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2406:x1870604214102016:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947815.929015:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2406:x1870604214102016:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947815.929022:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000040:00080000:0.0:1783947816.180558:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1783947816.709617:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4aec5925-d4b7-4c93-a83c-72b2db0b1155 00010000:00010000:2.0:1783947816.888126:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947817.915556:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947818.228651:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236229376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947818.228724:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947818.228821:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236229376 00000100:00100000:3.0:1783947818.228839:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236229376 00000100:00100000:3.0:1783947818.228906:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947818.228915:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236229376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947818.228945:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947818.228994:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236229376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.229001:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947818.229357:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236229376:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783947818.229532:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1783947818.401453:0:25689:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5e7e9c30 20000000:00000080:2.0:1783947818.401500:0:25689:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7beea03000 uarg=0000000000000000 20000000:01000000:2.0:1783947818.401543:0:25689:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947818.401549:0:25689:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947818.401555:0:25689:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783947818.412356:0:25690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1783947818.412634:0:25689:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783947818.423092:0:25689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783947818.423274:0:25689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423295:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423304:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423327:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423334:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423343:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423351:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423358:0:25689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423401:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423416:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 12 pid: 22656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.423432:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229504:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947818.423567:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423575:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.423583:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229632:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947818.423640:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423648:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 23 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.423658:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229760:0@lo:104: 00000100:00100000:0.0:1783947818.423706:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947818.423829:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423838:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 23 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.423846:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229888:0@lo:104: 00000100:00100000:0.0:1783947818.423865:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947818.423885:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423892:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 23 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.423900:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236230016:0@lo:104: 00000100:00100000:0.0:1783947818.423919:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947818.423935:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947818.423943:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 23 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.423962:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236230144:0@lo:104: 00000100:00100000:0.0:1783947818.423984:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947818.423993:0:25689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947818.424202:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236229760 00000100:00100000:3.0:1783947818.424210:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236229760 00000100:00100000:3.0:1783947818.424247:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236229888 00000100:00100000:3.0:1783947818.424249:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236229888 00000100:00100000:3.0:1783947818.424259:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230016 00000100:00100000:3.0:1783947818.424262:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230016 00000100:00100000:3.0:1783947818.424269:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230144 00000100:00100000:3.0:1783947818.424272:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230144 00000100:00100000:3.0:1783947818.424283:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947818.424292:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+6:25689:x1870604236229760:12345-0@lo:104: 00010000:00010000:3.0:1783947818.424305:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424371:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783947818.424377:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+6:25689:x1870604236229760:12345-0@lo:104: Request processed in 86us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.424383:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947818.424403:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947818.424408:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+5:25689:x1870604236229888:12345-0@lo:104: 00010000:00010000:3.0:1783947818.424416:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424449:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783947818.424478:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+5:25689:x1870604236229888:12345-0@lo:104: Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.424484:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947818.424497:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947818.424502:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:25689:x1870604236230016:12345-0@lo:104: 00010000:00010000:3.0:1783947818.424518:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424550:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783947818.424555:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+4:25689:x1870604236230016:12345-0@lo:104: Request processed in 53us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.424562:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947818.424573:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947818.424578:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:25689:x1870604236230144:12345-0@lo:104: 00010000:00010000:3.0:1783947818.424585:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424610:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783947818.424627:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+3:25689:x1870604236230144:12345-0@lo:104: Request processed in 48us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.424633:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783947818.424650:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783947818.424655:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424662:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947818.424667:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424675:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947818.424682:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947818.424694:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947818.424722:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424728:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947818.424820:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424829:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b200/0xe6fd1fdb55501f53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501f5a expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424842:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783947818.424845:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424850:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947818.424852:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424858:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947818.424864:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947818.424868:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947818.424882:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424887:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947818.424910:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424916:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5ec00/0xe6fd1fdb55501dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501dd9 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424924:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947818.424927:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424933:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947818.424936:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424942:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947818.424948:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947818.424953:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947818.424966:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424972:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947818.424978:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.424984:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb55501d93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d9a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.425006:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947818.425009:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.425015:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947818.425018:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.425024:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947818.425030:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947818.425035:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947818.425048:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.425053:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947818.425059:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.425065:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb55501d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501d8c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.425091:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947818.425093:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947818.425094:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947818.426213:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947818.426228:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947818.426260:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236230272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947818.426316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947818.426366:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947818.426372:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236230656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947818.426395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947818.426423:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236230400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947818.426444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947818.426476:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947818.426483:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236230528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947818.426502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947818.426528:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230272 00000100:00100000:3.0:1783947818.426534:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230272 00010000:00010000:3.0:1783947818.426563:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 24 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947818.426595:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230656 00000100:00100000:3.0:1783947818.426598:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230656 00010000:00010000:3.0:1783947818.426610:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 25 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947818.426633:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230400 00000100:00100000:3.0:1783947818.426635:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230400 00010000:00010000:3.0:1783947818.426645:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 26 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947818.426655:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230528 00000100:00100000:3.0:1783947818.426657:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230528 00010000:00010000:3.0:1783947818.426668:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 27 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947818.426693:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947818.426701:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+27:3638:x1870604236230272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947818.426712:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947818.426718:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 27 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.426726:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 27 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947818.427191:0:22646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783947818.427200:0:22646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783947818.427303:0:22647:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783947818.427313:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947818.427321:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+27:3638:x1870604236230656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947818.427330:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947818.427335:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 27 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947818.427705:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229760:0@lo:104: 00000100:00100000:0.0:1783947818.427717:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229888:0@lo:104: 00000100:00100000:0.0:1783947818.427725:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236230016:0@lo:104: 00000100:00100000:0.0:1783947818.427732:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236230144:0@lo:104: 00010000:00010000:3.0:1783947818.427910:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501f5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501f53 expref: 27 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430180:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 26 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430204:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb55501d8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501d85 expref: 26 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430220:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947818.430304:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+25:3638:x1870604236230656:12345-0@lo:103:ldlm_bl.0 Request processed in 2983us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947818.430315:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947818.430347:0:22647:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783947818.430359:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947818.430370:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3639:x1870604236230400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947818.430384:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947818.430390:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 24 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430398:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 24 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430407:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55501dd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501dd2 expref: 24 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430426:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947818.430481:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:3639:x1870604236230400:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947818.430488:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947818.430500:0:22647:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783947818.430506:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947818.430512:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:3639:x1870604236230528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947818.430520:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947818.430525:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 22 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430533:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 22 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430542:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501d9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501d93 expref: 22 pid: 22655 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.430550:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947818.430573:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:3639:x1870604236230528:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947818.430579:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947818.430631:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236230528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947818.430641:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39423f5f-9729-4dc0-9c01-dc528f57ea81:3639:1870604236230400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947818.431131:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236230656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947818.431423:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229504:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947818.431433:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870604236229632:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947818.431844:0:25689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.431983:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947818.432225:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:3638:x1870604236230272:12345-0@lo:103:ldlm_bl.0 Request processed in 5523us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.432235:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947818.432404:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947818.432489:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102656 00000100:00100000:3.0:1783947818.432496:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102656 00010000:00010000:3.0:1783947818.432523:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 13 pid: 22656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947818.432550:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1783947818.432557:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beb558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:2406:x1870604214102656:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947818.432568:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947818.432573:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 13 pid: 22656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.432596:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 13 pid: 22656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.432621:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb555020fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44f9 expref: 13 pid: 22656 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947818.432632:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947818.432677:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beb558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:2406:x1870604214102656:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947818.432684:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1783947818.432976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947818.433366:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102528 00000100:00100000:2.0:1783947818.433372:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102528 00010000:00010000:2.0:1783947818.433392:0:25691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947818.433422:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:2.0:1783947818.433429:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:2406:x1870604214102528:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947818.433438:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947818.433443:0:25691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433452:0:25691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433483:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9ba00/0xe6fd1fdb555020bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4489 expref: 12 pid: 22654 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433496:0:25691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433504:0:25691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433518:0:25691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433535:0:25691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433541:0:25691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433546:0:25691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433552:0:25691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947818.433556:0:25691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433563:0:25691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433577:0:25691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433586:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947818.433625:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:2406:x1870604214102528:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 184us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947818.433632:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00010000:00010000:2.0:1783947818.433656:0:25689:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433663:0:25689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947818.433669:0:25689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e50e00/0xe6fd1fdb5550212f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947818.436084:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39423f5f-9729-4dc0-9c01-dc528f57ea81:3638:1870604236230272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947818.931921:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947819.256802:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236230912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947819.256878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.256964:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236230784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947819.256990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.257309:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230912 00000100:00100000:2.0:1783947819.257319:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230912 00000100:00100000:2.0:1783947819.257367:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947819.257376:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236230912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947819.257411:0:24184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947819.257493:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236230912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947819.257500:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947819.257547:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236230912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947819.257803:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236230784 00000100:00100000:3.0:1783947819.257808:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236230784 00000100:00100000:3.0:1783947819.257853:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947819.257860:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236230784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947819.257876:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947819.257913:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236230784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.257920:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947819.258604:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236231040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947819.258656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947819.258774:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231040 00000100:00100000:0.0:1783947819.258780:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231040 00000100:00100000:0.0:1783947819.258822:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947819.258831:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236231040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947819.258852:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783947819.258894:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236231040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947819.258901:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947819.258947:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236231040:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783947819.259258:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947819.259300:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236230784:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1783947819.637909:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947819.637916:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be3edb000 from 13 10000000:01000000:2.0:1783947819.637922:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947819.637972:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947819.637983:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947819.637994:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947819.638038:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947819.638107:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.638153:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947819.638228:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231168 00000100:00100000:3.0:1783947819.638236:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231168 00000100:00100000:3.0:1783947819.638301:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783947819.638310:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+20:22658:x1870604236231168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947819.638324:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947819.638343:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb5550213d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55502136 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.638365:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb5550213d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55502136 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.638376:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d51a00/0xe6fd1fdb5550213d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55502136 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.638385:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51a00, rc 0) 00000100:00100000:3.0:1783947819.638438:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236231168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.638444:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783947819.638789:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947819.638803:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550213d expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947819.638812:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550213d expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947819.638873:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947819.638916:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.638948:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947819.639685:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231296 00000100:00100000:0.0:1783947819.639692:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231296 00000100:00100000:0.0:1783947819.639735:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783947819.639744:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236231296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.639889:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236231296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947819.639896:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783947819.640027:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947819.640072:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947819.640111:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.640140:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45aeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947819.640484:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231424 00000100:00100000:1.0:1783947819.640491:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231424 00000100:00100000:1.0:1783947819.640528:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947819.640535:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236231424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947819.640644:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236231424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947819.640650:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783947819.640902:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783947819.642025:0:25703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783947819.652581:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783947819.652632:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947819.652646:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550213d expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.652657:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55502136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550213d expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947819.652668:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947819.652670:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bfb129000 from 13 10000000:01000000:1.0:1783947819.652673:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947819.652716:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.652724:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.652734:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947819.652786:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947819.652855:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947819.652893:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7d56b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947819.653141:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231552 00000100:00100000:0.0:1783947819.653150:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231552 00000100:00100000:0.0:1783947819.653209:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783947819.653219:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+21:22658:x1870604236231552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947819.653232:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947819.653246:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb5550214b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55502144 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.653269:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb5550214b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55502144 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.653280:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb5550214b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55502144 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.653298:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51400, rc 0) 00000100:00100000:0.0:1783947819.653345:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236231552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947819.653352:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783947819.653662:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947819.653680:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550214b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.653688:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550214b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947819.653746:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947819.653787:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947819.653813:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7d56b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947819.653934:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231680 00000100:00100000:0.0:1783947819.653938:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231680 00000100:00100000:0.0:1783947819.653972:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783947819.653980:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236231680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.654138:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236231680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947819.654146:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783947819.658409:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947819.658509:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947819.658602:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.658640:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947819.659042:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231808 00000100:00100000:0.0:1783947819.659050:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231808 00000100:00100000:0.0:1783947819.659116:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783947819.659127:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236231808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.659263:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236231808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947819.659271:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783947819.659408:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783947819.660121:0:25704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783947819.660179:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783947819.660198:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947819.660208:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550214b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.660218:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438000/0xe6fd1fdb55502144 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550214b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947819.660228:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947819.660231:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be7b4d000 from 13 10000000:01000000:3.0:1783947819.660234:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947819.660263:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.660271:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.660299:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947819.660317:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.660356:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947819.660374:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc90ce240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947819.661203:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236231936 00000100:00100000:1.0:1783947819.661210:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236231936 00000100:00100000:1.0:1783947819.661248:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783947819.661257:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+22:22658:x1870604236231936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947819.661273:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947819.661301:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55502159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55502152 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.661330:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55502159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55502152 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.661342:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb55502159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55502152 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947819.661366:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439c00, rc 0) 00000100:00100000:1.0:1783947819.661430:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236231936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947819.661437:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783947819.661984:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236231936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947819.662002:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55502159 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.662011:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55502159 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947819.662088:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.662124:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947819.662158:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc90ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947819.662780:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232064 00000100:00100000:0.0:1783947819.662787:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232064 00000100:00100000:0.0:1783947819.662827:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783947819.662835:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236232064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.662975:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236232064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947819.662982:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947819.663554:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.663605:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.663651:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947819.663676:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc90ce240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947819.663983:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232192 00000100:00100000:3.0:1783947819.663989:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232192 00000100:00100000:3.0:1783947819.664025:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783947819.664032:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236232192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.664133:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236232192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.664147:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783947819.664187:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783947819.673646:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783947819.677244:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783947819.677291:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947819.677302:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55502159 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.677315:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d50800/0xe6fd1fdb55502152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55502159 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947819.677326:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947819.677329:0:22658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bf7a56000 from 13 10000000:01000000:0.0:1783947819.677331:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947819.677369:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.677377:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.677389:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947819.677431:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.677512:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947819.677546:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947819.677667:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232320 00000100:00100000:3.0:1783947819.677674:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232320 00000100:00100000:3.0:1783947819.677721:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783947819.677730:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+23:22658:x1870604236232320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947819.677742:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947819.677753:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55502167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55502160 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.677785:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55502167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55502160 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.677795:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d51800/0xe6fd1fdb55502167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55502160 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.677803:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51800, rc 0) 00000100:00100000:3.0:1783947819.677841:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236232320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.677848:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783947819.678130:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947819.678144:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55502167 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947819.678154:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55502167 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947819.678204:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.678226:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947819.678286:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947819.684919:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232448 00000100:00100000:3.0:1783947819.684935:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232448 00000100:00100000:3.0:1783947819.685001:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947819.685013:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc68c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236232448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.685186:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc68c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236232448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (6959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.685210:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783947819.685935:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.685989:0:22658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947819.686040:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947819.686069:0:22658:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947819.687508:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232576 00000100:00100000:3.0:1783947819.687521:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232576 00000100:00100000:3.0:1783947819.687581:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783947819.687601:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236232576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947819.687736:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:22658:x1870604236232576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.687743:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783947819.692423:0:22658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39423f5f-9729-4dc0-9c01-dc528f57ea81:22658:1870604236232576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947819.695252:0:25706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783947819.698388:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783947819.698423:0:22658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947819.698437:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55502167 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947819.698451:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb55502160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55502167 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947819.763740:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947819.763764:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236232704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947819.763833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947819.763923:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232704 00000100:00100000:3.0:1783947819.763930:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232704 00000100:00100000:3.0:1783947819.763996:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947819.764005:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236232704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947819.764033:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1783947819.764081:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236232704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.764087:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947819.764127:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236232704:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783947819.764233:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947819.765939:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236232832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947819.766010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947819.766218:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232832 00000100:00100000:1.0:1783947819.766226:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232832 00000100:00100000:1.0:1783947819.766289:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947819.766297:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236232832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947819.766320:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1783947819.766365:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236232832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947819.766371:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947819.766410:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236232832:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783947819.766543:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947819.766819:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236233088:0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.766852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.766878:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236233600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.766912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.766930:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783947819.766936:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236232960:0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.766955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.766969:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236233472:0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.766998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947819.767025:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236233600 00000100:00100000:2.0:1783947819.767029:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236233600 00000100:00100000:2.0:1783947819.767059:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236232960 00000100:00100000:2.0:1783947819.767062:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236232960 00000100:00100000:2.0:1783947819.767074:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236233472 00000100:00100000:2.0:1783947819.767078:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236233472 00000100:00100000:2.0:1783947819.767092:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947819.767098:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236233600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.767138:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236233600:12345-0@lo:400:kworker.0 Request processed in 40us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947819.767145:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947819.767173:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947819.767178:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236232960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.767207:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236232960:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947819.767213:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947819.767224:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783947819.767229:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236233472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.767253:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236233472:12345-0@lo:400:kworker.0 Request processed in 24us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947819.767269:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783947819.767285:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947819.767288:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947819.767305:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236232960:0@lo:400:kworker.0 00010000:00080000:2.0:1783947819.767317:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7502d80 x1870604236233472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947819.767327:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236233472:0@lo:400:kworker.0 00000100:00100000:2.0:1783947819.767336:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236233600:0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.767786:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236233344:0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.767818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947819.767851:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783947819.767858:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236233216:0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.767880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947819.767898:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236233728:0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.767925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947819.767944:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236233344 00000100:00100000:1.0:1783947819.767948:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236233344 00000100:00100000:1.0:1783947819.767979:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236233216 00000100:00100000:1.0:1783947819.767988:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236233216 00000100:00100000:1.0:1783947819.768003:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236233728 00000100:00100000:1.0:1783947819.768013:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236233728 00000100:00100000:1.0:1783947819.768032:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783947819.768039:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.768078:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236233344:12345-0@lo:400:kworker.0 Request processed in 39us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947819.768085:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783947819.768100:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947819.768106:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236233216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.768133:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236233216:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947819.768139:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947819.768150:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947819.768156:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236233728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.768181:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236233728:12345-0@lo:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947819.768186:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783947819.768201:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947819.768204:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947819.768222:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236233216:0@lo:400:kworker.0 00010000:00080000:1.0:1783947819.768232:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7501180 x1870604236233728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947819.768240:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236233728:0@lo:400:kworker.0 00000100:00100000:1.0:1783947819.768249:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236233344:0@lo:400:kworker.0 00000100:00100000:3.0:1783947819.770027:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236233088 00000100:00100000:3.0:1783947819.770056:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236233088 00000100:00100000:3.0:1783947819.770132:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947819.770142:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236233088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947819.770248:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236233088:12345-0@lo:400:kworker.0 Request processed in 108us (3394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947819.770255:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947819.774394:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236233088:0@lo:400:kworker.0 00010000:00010000:3.0:1783947819.958428:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947820.133835:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.133934:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102784 00000100:00100000:3.0:1783947820.133946:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102784 00000100:00100000:3.0:1783947820.134026:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 158 00000100:00100000:3.0:1783947820.134038:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+11:18131:x1870604214102784:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947820.134059:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947820.134084:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d51000/0xe6fd1fdb5550216e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4531 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.134121:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d51000/0xe6fd1fdb5550216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4531 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.134507:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d51000/0xe6fd1fdb5550216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4531 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.134523:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51000, rc 0) 00000100:00100000:3.0:1783947820.134655:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18131:x1870604214102784:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 619us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.134663:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 158 00000100:00100000:0.0:1783947820.146506:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.146633:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214102912 00000100:00100000:1.0:1783947820.146647:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214102912 00000100:00100000:1.0:1783947820.146740:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:1.0:1783947820.146752:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18131:x1870604214102912:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947820.146997:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18131:x1870604214102912:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 246us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947820.147005:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:2.0:1783947820.153097:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.153405:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103040 00000100:00100000:3.0:1783947820.153417:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103040 00000100:00100000:3.0:1783947820.153527:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:3.0:1783947820.153557:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18131:x1870604214103040:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947820.153755:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18131:x1870604214103040:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 201us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.153764:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:0.0:1783947820.161762:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947820.162023:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103168 00000100:00100000:2.0:1783947820.162035:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103168 00000100:00100000:2.0:1783947820.162111:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:2.0:1783947820.162123:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+12:18131:x1870604214103168:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947820.162155:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947820.162180:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55502175 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4538 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.162238:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55502175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4538 expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.162251:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55502175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4538 expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.162274:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ac00, rc 0) 00000100:00100000:2.0:1783947820.162348:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18131:x1870604214103168:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 227us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947820.162355:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:0.0:1783947820.171679:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.171790:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103296 00000100:00100000:1.0:1783947820.171803:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103296 00000100:00100000:1.0:1783947820.171875:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:1.0:1783947820.171887:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18131:x1870604214103296:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947820.172093:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18131:x1870604214103296:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 208us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947820.172102:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:0.0:1783947820.179433:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.180319:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103424 00000100:00100000:3.0:1783947820.180345:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103424 00000100:00100000:3.0:1783947820.180425:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1783947820.180437:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18131:x1870604214103424:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947820.180676:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:18131:x1870604214103424:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 241us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.180684:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000040:00080000:1.0:1783947820.212514:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783947820.324797:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.325168:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103552 00000100:00100000:1.0:1783947820.325181:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103552 00000100:00100000:1.0:1783947820.325292:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1783947820.325306:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+6:18757:x1870604214103552:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947820.325337:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947820.325369:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550217c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e453f expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.325500:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.325542:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.325558:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.325591:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783947820.325714:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947820.325995:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326004:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326184:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb55502191 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326192:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb55502191 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326199:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb55502191 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947820.326237:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783947820.326241:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947820.326281:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb55502191 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326293:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326313:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326320:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326326:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947820.326330:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326337:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326351:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:1.0:1783947820.326354:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947820.326359:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326365:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326382:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326387:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326392:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326396:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947820.326404:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326410:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.326417:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e7c003e5d00) 00010000:00010000:1.0:1783947820.331075:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947820.331100:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.331115:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550218a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.331212:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550217c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e453f expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.331247:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb55502191 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e453f expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.331257:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:1.0:1783947820.331260:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947820.331263:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438a00, rc 0) 00000100:00100000:1.0:1783947820.331371:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+7:18757:x1870604214103552:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 6068us (6587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947820.331382:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:0.0:1783947820.336878:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.337198:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103680 00000100:00100000:3.0:1783947820.337211:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103680 00000100:00100000:3.0:1783947820.337312:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1783947820.337325:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f708495a-69fd-4413-8caa-ba048b1b3556+7:18757:x1870604214103680:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783947820.337453:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f708495a-69fd-4413-8caa-ba048b1b3556+7:18757:x1870604214103680:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 Request processed in 130us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.337492:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1783947820.343812:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947820.343974:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214103936 00000100:00100000:2.0:1783947820.343989:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214103936 00000100:00100000:2.0:1783947820.344073:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1783947820.344085:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+7:18757:x1870604214103936:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947820.344115:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947820.344148:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502198 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4546 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344266:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344285:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344299:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344340:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344349:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344356:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344860:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555021ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344874:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555021ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.344882:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555021ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947820.344893:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783947820.345104:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345113:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345120:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345128:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947820.345134:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345153:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345169:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:2.0:1783947820.345172:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947820.345178:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345184:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb5550219f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345201:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345208:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345214:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345778:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9be00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947820.345783:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345791:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345803:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e7bfcba1700) 00010000:00010000:2.0:1783947820.345806:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947820.345809:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.345831:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555021a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.349533:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502198 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4546 expref: 10 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.349571:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555021ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4546 expref: 9 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.349592:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bfcba1100) 00010000:00010000:2.0:1783947820.349663:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947820.349668:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a200, rc 0) 00000100:00100000:2.0:1783947820.349840:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+9:18757:x1870604214103936:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 5754us (6039us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783947820.349851:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1783947820.360359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.360602:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104064 00000100:00100000:1.0:1783947820.360616:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104064 00000100:00100000:1.0:1783947820.360692:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:1.0:1783947820.360706:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+9:18757:x1870604214104064:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783947820.364163:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+9:18757:x1870604214104064:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 3443us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947820.364182:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:0.0:1783947820.367519:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947820.367687:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104192 00000100:00100000:2.0:1783947820.367700:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104192 00000100:00100000:2.0:1783947820.367797:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1783947820.367810:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+5:18757:x1870604214104192:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1783947820.367939:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1783947820.369305:0:22663:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1438us 00000100:00100000:0.0:1783947820.431766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947820.431822:0:22662:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947820.431835:0:22662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783947820.432185:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104320 00000100:00100000:0.0:1783947820.432197:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104320 00000100:00100000:0.0:1783947820.432407:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:0.0:1783947820.432419:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+9:18763:x1870604214104320:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947820.432446:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947820.432491:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e454d expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432567:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432606:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432620:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432636:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432644:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432657:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432722:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432729:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432737:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432743:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.432748:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432756:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432771:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:0.0:1783947820.432774:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.432778:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432784:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432796:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432802:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432821:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432827:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.432830:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432837:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432844:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e7c003e9d00) 00010000:00010000:0.0:1783947820.432846:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.432849:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.432854:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.434163:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e454d expref: 10 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.434192:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:0.0:1783947820.434195:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.434204:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e454d expref: 10 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.434223:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51c00, rc 0) 00000100:00100000:0.0:1783947820.434317:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+9:18763:x1870604214104320:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1898us (2564us total) trans 0 rc 301/301 00000100:00100000:0.0:1783947820.434342:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1783947820.438333:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+5:18757:x1870604214104192:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 70508us (70862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947820.438352:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1783947820.442622:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.445212:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104448 00000100:00100000:1.0:1783947820.445231:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104448 00000100:00100000:1.0:1783947820.445414:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1783947820.445426:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f708495a-69fd-4413-8caa-ba048b1b3556+9:18763:x1870604214104448:12345-192.168.204.3@tcp:700:lfs.0 00000100:00100000:1.0:1783947820.445564:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f708495a-69fd-4413-8caa-ba048b1b3556+9:18763:x1870604214104448:12345-192.168.204.3@tcp:700:lfs.0 Request processed in 141us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947820.445582:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1783947820.454493:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947820.454840:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104704 00000100:00100000:2.0:1783947820.454871:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104704 00000100:00100000:2.0:1783947820.454964:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1783947820.454976:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+9:18763:x1870604214104704:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:2.0:1783947820.455055:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947820.455269:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555020e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e44ba expref: 9 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.455300:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:2.0:1783947820.455307:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947820.455392:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.455410:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 5 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.455420:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.456085:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 5 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.456118:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 5 pid: 22663 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947820.456137:0:22662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22662:1870604236233856:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947820.456251:0:22662:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45ae780 going to sleep for 11 seconds 00000100:00100000:2.0:1783947820.469435:0:22662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22662:1870604236233856:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947820.469529:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947820.473195:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.473367:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104832 00000100:00100000:3.0:1783947820.473379:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104832 00010000:00010000:3.0:1783947820.473480:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 6 pid: 22663 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947820.473600:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947820.474079:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:3.0:1783947820.474122:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2407:x1870604214104832:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947820.474145:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947820.474154:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 6 pid: 22663 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.474170:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 6 pid: 22663 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.474196:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e452a expref: 6 pid: 22663 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.474216:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:3.0:1783947820.474223:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.474235:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.474244:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.474290:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947820.474376:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2407:x1870604214104832:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 258us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.474385:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00010000:00010000:0.0:1783947820.474490:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.474500:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.474532:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.474544:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.474554:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.477668:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478029:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478066:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947820.478101:0:22662:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069baeceb reply state 000000005664bc60 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478118:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478126:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947820.478130:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947820.478135:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783947820.478142:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783947820.478153:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478160:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478167:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478174:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.478180:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478188:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478200:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e9c00) 00010000:00010000:0.0:1783947820.478203:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.478214:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478221:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb555021d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947820.478250:0:22662:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069baeceb reply state 000000005664bc60 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478260:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.478266:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e7c003e9d00) 00010000:00010000:0.0:1783947820.478269:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947820.478271:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783947820.478413:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+10:18763:x1870604214104704:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 23433us (23969us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783947820.478425:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:0.0:1783947820.641754:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.642012:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214104960 00000100:00100000:3.0:1783947820.642027:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214104960 00000100:00100000:3.0:1783947820.642117:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1783947820.642132:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+10:18771:x1870604214104960:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:3.0:1783947820.642189:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947820.642222:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb555021e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4554 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.642313:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50a00/0xe6fd1fdb555021ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.642331:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50a00/0xe6fd1fdb555021ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.642345:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50a00/0xe6fd1fdb555021ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947820.642408:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947820.642412:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947820.642508:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50a00/0xe6fd1fdb555021ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.642537:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb555021e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4554 expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.642559:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50a00/0xe6fd1fdb555021ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4554 expref: 11 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.642582:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:3.0:1783947820.642585:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947820.642598:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d50a00, rc 0) 00000100:00100000:3.0:1783947820.642685:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+11:18771:x1870604214104960:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 557us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.642694:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:1.0:1783947820.699539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947820.699746:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214105088 00000100:00100000:0.0:1783947820.699760:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214105088 00000100:00100000:0.0:1783947820.699849:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:0.0:1783947820.699861:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:18772:x1870604214105088:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947820.699892:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947820.699919:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e455b expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.700009:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555021fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.700027:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555021fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.700072:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555021fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947820.700137:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947820.700142:0:25709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947820.700171:0:25709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555021fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.700203:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555021f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e455b expref: 7 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.700230:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50800/0xe6fd1fdb555021fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e455b expref: 6 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.700241:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:0.0:1783947820.700244:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947820.700249:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50800, rc 0) 00000100:00100000:0.0:1783947820.700341:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18772:x1870604214105088:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 482us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947820.700350:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1783947820.705413:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.705623:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214105216 00000100:00100000:3.0:1783947820.705636:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214105216 00000100:00100000:3.0:1783947820.705722:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:3.0:1783947820.705734:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:18772:x1870604214105216:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947820.705764:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947820.705792:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4562 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.705880:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.705900:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.705914:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.705927:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.705934:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.705940:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706045:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb55502216 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706192:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb55502216 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706328:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb55502216 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947820.706386:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947820.706390:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947820.706420:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb55502216 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706434:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706440:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706447:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706453:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947820.706682:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706748:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706769:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:3.0:1783947820.706773:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947820.706779:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706787:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb55502208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706821:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706828:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706834:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706840:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947820.706843:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706848:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706856:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e7c003e9d00) 00010000:00010000:3.0:1783947820.706859:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947820.706862:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706867:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb5550220f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706904:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb55502201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4562 expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706920:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb55502216 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4562 expref: 7 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.706940:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:3.0:1783947820.706943:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947820.706946:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d50e00, rc 0) 00000100:00100000:3.0:1783947820.707039:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:18772:x1870604214105216:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1307us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.707049:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1783947820.714309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.714546:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214105344 00000100:00100000:3.0:1783947820.714559:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214105344 00000100:00100000:3.0:1783947820.714660:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:3.0:1783947820.714672:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:18772:x1870604214105344:12345-192.168.204.3@tcp:900:lfs.0 00000100:00100000:3.0:1783947820.714801:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:18772:x1870604214105344:12345-192.168.204.3@tcp:900:lfs.0 Request processed in 131us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.714811:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00080000:1.0:1783947820.714982:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947820.718969:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947820.719179:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214105600 00000100:00100000:2.0:1783947820.719193:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214105600 00000100:00100000:2.0:1783947820.719432:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1783947820.719446:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+7:18772:x1870604214105600:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947820.719517:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947820.719564:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb5550221d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4569 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947820.719740:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783947820.719880:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb5550221d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4569 expref: 9 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.719898:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:2.0:1783947820.719901:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947820.719907:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb5550221d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4569 expref: 9 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947820.719925:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b000, rc 0) 00000100:00100000:2.0:1783947820.720019:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+8:18772:x1870604214105600:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 576us (1065us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1783947820.720027:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1783947820.723801:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.729743:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214105856 00000100:00100000:3.0:1783947820.729767:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214105856 00000100:00100000:3.0:1783947820.729886:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1783947820.729900:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+8:18772:x1870604214105856:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:3.0:1783947820.729981:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947820.730018:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb55502216 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4562 expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.730045:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:3.0:1783947820.730051:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947820.730083:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.730124:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.730137:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947820.730426:0:22663:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d2d434e reply state 00000000b7a7e438 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.730443:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.730450:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:3.0:1783947820.730453:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1783947820.730675:0:22663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783947820.730686:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783947820.730855:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+9:18772:x1870604214105856:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 957us (7068us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1783947820.730865:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:2.0:1783947820.738511:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.738674:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214106112 00000100:00100000:3.0:1783947820.738692:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214106112 00000100:00100000:3.0:1783947820.738795:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1783947820.738809:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+9:18772:x1870604214106112:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1783947820.739554:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+10:18772:x1870604214106112:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 741us (1056us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1783947820.739577:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1783947820.743904:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947820.744045:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214106368 00000100:00100000:0.0:1783947820.744127:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214106368 00000100:00100000:0.0:1783947820.744412:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1783947820.744436:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+10:18772:x1870604214106368:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947820.744523:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947820.744554:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4570 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.744961:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.744985:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745001:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745015:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745023:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745030:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947820.745205:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783947820.745658:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745669:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745677:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745684:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.745689:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745870:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745892:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:0.0:1783947820.745896:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.745905:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745913:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745937:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745944:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745951:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745957:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.745960:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745966:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745974:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e7c003e9d00) 00010000:00010000:0.0:1783947820.745977:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.745980:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.745998:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502240 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.750501:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502232 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4570 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.750543:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:0.0:1783947820.750546:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947820.750559:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4570 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.750597:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50400, rc 0) 00000100:00100000:0.0:1783947820.750727:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+11:18772:x1870604214106368:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 6302us (6841us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1783947820.750739:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:2.0:1783947820.754745:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.754900:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214106496 00000100:00100000:3.0:1783947820.754914:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214106496 00000100:00100000:3.0:1783947820.755019:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:3.0:1783947820.755032:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+11:18772:x1870604214106496:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947820.755185:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947820.755228:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550224e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4577 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.755379:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.755400:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.755417:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947820.755622:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947820.755627:0:22663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947820.755654:0:22663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.755766:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550224e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.755793:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947820.755804:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:3.0:1783947820.755807:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947820.755811:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d51200, rc 0) 00000100:00100000:3.0:1783947820.755898:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+12:18772:x1870604214106496:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 869us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947820.755923:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1783947820.760682:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.760862:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214106624 00000100:00100000:1.0:1783947820.760877:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214106624 00000100:00100000:1.0:1783947820.760978:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:1.0:1783947820.760991:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+12:18772:x1870604214106624:12345-192.168.204.3@tcp:37:lfs.0 00000100:00100000:1.0:1783947820.775940:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+12:18772:x1870604214106624:12345-192.168.204.3@tcp:37:lfs.0 Request processed in 14933us (15464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947820.775959:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947820.783920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.784027:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214106880 00000100:00100000:3.0:1783947820.784040:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214106880 00000100:00100000:3.0:1783947820.784127:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:3.0:1783947820.784139:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+12:18772:x1870604214106880:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1783947820.784755:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+13:18772:x1870604214106880:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 556us (789us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1783947820.784765:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:2.0:1783947820.856551:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947820.856818:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214107008 00000100:00100000:0.0:1783947820.856833:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214107008 00000100:00100000:0.0:1783947820.856926:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:0.0:1783947820.856939:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+11:18778:x1870604214107008:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947820.856968:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947820.856998:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550225c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e457e expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857083:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857103:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857139:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857154:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857162:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857168:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857297:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb55502271 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857307:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb55502271 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857314:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb55502271 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947820.857359:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947820.857363:0:25709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947820.857406:0:25709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb55502271 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857432:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857440:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857499:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857506:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.857510:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857519:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857534:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:0.0:1783947820.857538:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.857543:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857550:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857577:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857955:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857962:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857967:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947820.857970:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857988:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.857998:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e7c003e9d00) 00010000:00010000:0.0:1783947820.858000:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947820.858003:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.858009:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550226a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.858044:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550225c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e457e expref: 13 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.858060:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb55502271 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e457e expref: 12 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.858068:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947820.858070:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783947820.858073:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51000, rc 0) 00000100:00100000:0.0:1783947820.858159:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+12:18778:x1870604214107008:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1222us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947820.858168:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:2.0:1783947820.865499:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947820.868850:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214107136 00000100:00100000:3.0:1783947820.868871:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214107136 00000100:00100000:2.0:1783947820.869203:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947820.869219:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f708495a-69fd-4413-8caa-ba048b1b3556+5:18778:x1870604214107136:12345-192.168.204.3@tcp:900:bash.0 00000100:00100000:2.0:1783947820.869397:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f708495a-69fd-4413-8caa-ba048b1b3556+5:18778:x1870604214107136:12345-192.168.204.3@tcp:900:bash.0 Request processed in 182us (3954us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947820.869424:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947820.876953:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.883926:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214107392 00000100:00100000:1.0:1783947820.883952:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214107392 00000100:00100000:1.0:1783947820.884440:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:1.0:1783947820.884476:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+12:18778:x1870604214107392:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947820.884510:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947820.884540:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55502278 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4585 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.885885:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.885913:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.885924:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.885975:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.885994:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 12 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947820.886013:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236233984:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947820.887576:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7d56480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947820.891930:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236233984:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947820.891973:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947820.896319:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947820.903850:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214107520 00000100:00100000:0.0:1783947820.903874:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214107520 00010000:00010000:0.0:1783947820.903946:0:25691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 13 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947820.904031:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:0.0:1783947820.904043:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4aec5925-d4b7-4c93-a83c-72b2db0b1155+13:2407:x1870604214107520:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947820.904334:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947820.904345:0:25691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 13 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.904360:0:25691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 13 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.904388:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51200/0xe6fd1fdb55502255 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4577 expref: 13 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.904408:0:25691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947820.904414:0:25691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.904426:0:25691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.904434:0:25691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.904507:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947820.904601:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4aec5925-d4b7-4c93-a83c-72b2db0b1155+12:2407:x1870604214107520:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 559us (8295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947820.904611:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00010000:00010000:1.0:1783947820.904714:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.904723:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.904753:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.904774:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.904783:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.905494:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.905509:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.905517:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947820.905532:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783947820.905576:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.906687:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908518:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908528:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947820.908534:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908546:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908612:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:1.0:1783947820.908615:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947820.908621:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908629:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550227f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947820.908653:0:22661:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007027039e reply state 0000000036d7c28d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908667:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.908675:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e7c003e5d00) 00010000:00010000:1.0:1783947820.908678:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947820.908681:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783947820.909010:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55502278 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 15 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.909032:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 14 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947820.909041:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947820.909044:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783947820.910026:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439e00, rc 0) 00000100:00100000:1.0:1783947820.910489:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+15:18778:x1870604214107392:12345-192.168.204.3@tcp:101:bash.0 Request processed in 26006us (33523us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783947820.910502:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:2.0:1783947820.941791:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947820.941952:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214107648 00000100:00100000:0.0:1783947820.941983:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214107648 00000100:00100000:0.0:1783947820.942079:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:0.0:1783947820.942097:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+15:18778:x1870604214107648:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947820.942138:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947820.942166:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550229b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e458c expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942260:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942279:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942292:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947820.942354:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783947820.942359:0:25709:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947820.942385:0:25709:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942398:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942936:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550229b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e458c expref: 17 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942965:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e458c expref: 16 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947820.942975:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947820.942992:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947820.942997:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51e00, rc 0) 00000100:00100000:0.0:1783947820.943328:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+16:18778:x1870604214107648:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1233us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947820.943338:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:2.0:1783947820.949193:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947820.949502:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214107904 00000100:00100000:1.0:1783947820.949516:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214107904 00000100:00100000:1.0:1783947820.949598:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1783947820.949610:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+16:18778:x1870604214107904:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:1.0:1783947820.950012:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+17:18778:x1870604214107904:12345-192.168.204.3@tcp:35:bash.0 Request processed in 402us (832us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1783947820.950021:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00010000:00010000:3.0:1783947820.980405:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947821.042972:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.043022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.043130:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.052632:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947821.052726:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214108160 00000100:00100000:0.0:1783947821.052740:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214108160 00000100:00100000:0.0:1783947821.052856:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214108032 00000100:00100000:0.0:1783947821.052861:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214108032 00000100:00100000:0.0:1783947821.053627:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214108288 00000100:00100000:0.0:1783947821.053638:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214108288 00000100:00100000:0.0:1783947821.053685:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947821.053699:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214108160:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947821.053814:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+5:2406:x1870604214108160:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 119us (10857us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947821.053823:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947821.053842:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1783947821.053849:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+5:2407:x1870604214108032:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947821.053894:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+5:2407:x1870604214108032:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (10871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947821.053900:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1783947821.053912:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1783947821.053919:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2407:x1870604214108288:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947821.053942:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2407:x1870604214108288:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (10813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947821.053947:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00080000:0.0:1783947821.053989:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947821.053994:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947821.055554:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214108416 00000100:00100000:0.0:1783947821.061549:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214108416 00000100:00100000:0.0:1783947821.061703:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1783947821.061716:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2406:x1870604214108416:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947821.061837:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2406:x1870604214108416:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 123us (9221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947821.061846:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00080000:2.0:1783947821.062216:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947821.077747:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947821.078678:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214108672 00000100:00100000:3.0:1783947821.078695:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214108672 00000100:00100000:3.0:1783947821.078786:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947821.078799:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+17:18788:x1870604214108672:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947821.078833:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947821.078862:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb555022a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4593 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947821.079628:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783947821.079785:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb555022a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4593 expref: 19 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.079804:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:3.0:1783947821.079807:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947821.079813:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb555022a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4593 expref: 19 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.079854:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d50e00, rc 0) 00000100:00100000:3.0:1783947821.080015:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+18:18788:x1870604214108672:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1219us (2283us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1783947821.080024:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:0.0:1783947821.084365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947821.087143:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214108928 00000100:00100000:1.0:1783947821.087166:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214108928 00000100:00100000:1.0:1783947821.087266:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1783947821.087280:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+18:18788:x1870604214108928:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947821.087640:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+19:18788:x1870604214108928:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 362us (3288us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1783947821.087649:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:2.0:1783947821.156303:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947821.156415:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214109184 00000100:00100000:0.0:1783947821.156438:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214109184 00000100:00100000:0.0:1783947821.156574:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:0.0:1783947821.156587:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+19:18791:x1870604214109184:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947821.156622:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947821.156649:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555022b7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e459a expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947821.156795:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555022be lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947821.156812:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555022be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947821.156826:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555022be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947821.156839:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783947821.157013:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555022b7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e459a expref: 22 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947821.157036:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555022be lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e459a expref: 21 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947821.157057:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947821.157061:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947821.157065:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50c00, rc 0) 00000100:00100000:0.0:1783947821.157403:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+21:18791:x1870604214109184:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 816us (1111us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1783947821.157411:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:0.0:1783947821.162858:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947821.162923:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.163078:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214109312 00000100:00100000:2.0:1783947821.163102:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214109312 00000100:00100000:2.0:1783947821.163198:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:2.0:1783947821.163211:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f708495a-69fd-4413-8caa-ba048b1b3556+21:2407:x1870604214109312:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947821.163233:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947821.163267:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555022be lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e459a expref: 21 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.163288:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947821.163300:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947821.163379:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f708495a-69fd-4413-8caa-ba048b1b3556+20:2407:x1870604214109312:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 171us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947821.163389:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1783947821.164579:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214109440 00000100:00100000:1.0:1783947821.164592:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214109440 00000100:00100000:1.0:1783947821.164661:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:1.0:1783947821.164673:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+20:18791:x1870604214109440:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1783947821.164775:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164797:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164811:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164863:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164962:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164970:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164977:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947821.164983:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.164992:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.165007:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947821.165011:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947821.165016:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.165023:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947821.165351:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+20:18791:x1870604214109440:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 678us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947821.165360:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:3.0:1783947821.188542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947821.188680:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214109696 00000100:00100000:1.0:1783947821.188696:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214109696 00000100:00100000:1.0:1783947821.188785:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1783947821.188797:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+20:18791:x1870604214109696:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947821.189140:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+21:18791:x1870604214109696:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 345us (611us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1783947821.189168:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000040:00080000:1.0:1783947821.240395:0:23415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783947821.300294:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783947821.581381:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947821.581977:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214109952 00000100:00100000:1.0:1783947821.581994:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214109952 00000100:00100000:1.0:1783947821.582144:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:1.0:1783947821.582159:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+21:18822:x1870604214109952:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:1.0:1783947821.582212:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947821.582250:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022d3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45a1 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.582417:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555022da lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.582439:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555022da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.582501:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555022da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947821.582521:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783947821.582745:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022d3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45a1 expref: 24 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.582771:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555022da lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45a1 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.582782:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947821.582798:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947821.582820:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439600, rc 0) 00000100:00100000:1.0:1783947821.585195:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+23:18822:x1870604214109952:12345-192.168.204.3@tcp:101:cat.0 Request processed in 3013us (3803us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1783947821.585213:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1783947821.606749:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.607217:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214110080 00000100:00100000:2.0:1783947821.607232:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214110080 00000100:00100000:2.0:1783947821.607327:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947821.607360:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+23:2406:x1870604214110080:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947821.607382:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947821.607418:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555022da lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45a1 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.607443:0:25691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947821.607449:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947821.607617:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+22:2406:x1870604214110080:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 257us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947821.607626:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947821.617232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947821.617561:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214110336 00000100:00100000:1.0:1783947821.617584:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214110336 00000100:00100000:1.0:1783947821.617682:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:1.0:1783947821.617694:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+22:18822:x1870604214110336:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:1.0:1783947821.618928:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+23:18822:x1870604214110336:12345-192.168.204.3@tcp:35:cat.0 Request processed in 1226us (1706us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1783947821.618942:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947821.760704:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947821.769367:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214110592 00000100:00100000:1.0:1783947821.769474:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214110592 00000100:00100000:1.0:1783947821.769997:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:1.0:1783947821.770013:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+23:18828:x1870604214110592:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:1.0:1783947821.770048:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947821.770140:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022e8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45a8 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.770297:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb555022ef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.770316:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb555022ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.770330:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb555022ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947821.770343:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783947821.773502:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb555022e8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45a8 expref: 26 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.773542:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb555022ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45a8 expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947821.773565:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947821.774149:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947821.774156:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438600, rc 0) 00000100:00100000:1.0:1783947821.774370:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+25:18828:x1870604214110592:12345-192.168.204.3@tcp:101:dd.0 Request processed in 4357us (14994us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1783947821.774395:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1783947821.786671:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947821.787149:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.787329:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214110720 00000100:00100000:2.0:1783947821.787347:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214110720 00000100:00100000:3.0:1783947821.787494:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214110848 00000100:00100000:3.0:1783947821.787501:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214110848 00000100:00100000:2.0:1783947821.787559:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:3.0:1783947821.787570:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1783947821.787584:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f708495a-69fd-4413-8caa-ba048b1b3556+26:2409:x1870604214110848:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947821.787608:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947821.787648:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb555022ef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45a8 expref: 26 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.787675:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947821.787690:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947821.787763:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f708495a-69fd-4413-8caa-ba048b1b3556+25:2409:x1870604214110848:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 184us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947821.787771:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1783947821.789638:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+24:18828:x1870604214110720:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:2.0:1783947821.789681:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947821.789713:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555022fd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45af expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.790557:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.790583:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.790599:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.791998:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555022fd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 26 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.792031:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 25 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947821.792042:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947821.792045:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947821.792050:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b000, rc 0) 00000100:00100000:2.0:1783947821.793282:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+25:18828:x1870604214110720:12345-192.168.204.3@tcp:101:dd.0 Request processed in 3673us (6617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947821.793296:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:0.0:1783947821.797871:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947821.806267:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214111104 00000100:00100000:3.0:1783947821.806288:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214111104 00000100:00100000:3.0:1783947821.806819:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:3.0:1783947821.806843:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+25:18828:x1870604214111104:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:3.0:1783947821.806936:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947821.806974:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555022a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e458c expref: 25 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.807031:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947821.807038:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947821.807272:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.807291:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.807302:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947821.807356:0:22663:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1783947821.807384:0:22663:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd1f0b49 reply state 000000000b82ccc9 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.807398:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947821.807405:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947821.807409:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947821.807412:0:22663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947821.807859:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+27:18828:x1870604214111104:12345-192.168.204.3@tcp:36:dd.0 Request processed in 1022us (10000us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1783947821.811445:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000020:00080000:3.0:1783947821.811601:0:22663:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783947821.877745:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947821.877935:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214111360 00000100:00100000:2.0:1783947821.877950:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214111360 00000100:00100000:2.0:1783947821.878031:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1783947821.878044:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+27:18828:x1870604214111360:12345-192.168.204.3@tcp:35:dd.0 00000100:00100000:2.0:1783947821.878368:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+28:18828:x1870604214111360:12345-192.168.204.3@tcp:35:dd.0 Request processed in 326us (645us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1783947821.878377:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00010000:00010000:3.0:1783947822.003645:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947822.046579:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.046705:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214111488 00000100:00100000:0.0:1783947822.046717:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214111488 00000100:00100000:0.0:1783947822.046799:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:0.0:1783947822.046814:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+28:18842:x1870604214111488:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1783947822.046841:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947822.046865:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502312 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45b6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.046953:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.046968:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.046979:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047001:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047008:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047015:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047086:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047096:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047103:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947822.047147:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783947822.047151:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947822.047185:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047207:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047216:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047222:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047228:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047234:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947822.047238:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047245:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047255:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947822.047258:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947822.047263:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047269:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502319 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047281:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047287:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047299:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047304:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947822.047307:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047313:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047320:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e7c003e5d00) 00010000:00010000:0.0:1783947822.047322:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947822.047324:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047330:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502320 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047355:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502312 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45b6 expref: 30 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047368:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45b6 expref: 29 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.047376:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947822.047377:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947822.047380:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51e00, rc 0) 00000100:00100000:0.0:1783947822.047435:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+29:18842:x1870604214111488:12345-192.168.204.3@tcp:101:stat.0 Request processed in 628us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947822.047450:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00080000:2.0:1783947822.047821:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947822.099653:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947822.099829:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214111744 00000100:00100000:1.0:1783947822.099844:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214111744 00000100:00100000:1.0:1783947822.099930:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:1.0:1783947822.099944:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+29:18848:x1870604214111744:12345-192.168.204.3@tcp:36:truncate.0 00010000:00010000:1.0:1783947822.100021:0:22661:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947822.100170:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55502327 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45b6 expref: 29 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.100195:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947822.100200:0:22661:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947822.100620:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.100638:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.100649:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947822.100755:0:22661:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1783947822.100782:0:22661:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043655215 reply state 000000006a6e279a transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.100793:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.100798:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947822.100800:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947822.100802:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947822.100953:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+31:18848:x1870604214111744:12345-192.168.204.3@tcp:36:truncate.0 Request processed in 1010us (1314us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1783947822.100960:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000020:00080000:1.0:1783947822.100967:0:22661:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783947822.200763:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.201551:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214111872 00000100:00100000:0.0:1783947822.201567:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214111872 00000100:00100000:0.0:1783947822.201771:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1783947822.201784:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+31:18862:x1870604214111872:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1783947822.201820:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947822.201849:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502335 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45bd expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202010:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202030:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202046:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202060:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202068:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202076:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202793:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202834:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.202846:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947822.203825:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1783947822.203835:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947822.205659:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205698:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205714:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205723:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205730:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205737:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947822.205742:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205751:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205771:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947822.205796:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947822.205803:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205811:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb5550233c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205835:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205842:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205849:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205855:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947822.205858:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.205863:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.206896:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e7c003e5d00) 00010000:00010000:0.0:1783947822.206905:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947822.206910:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.206919:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502343 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.206988:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55502335 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 33 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.207030:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 32 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.207040:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947822.207042:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947822.207045:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51a00, rc 0) 00000100:00100000:0.0:1783947822.207163:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+32:18862:x1870604214111872:12345-192.168.204.3@tcp:101:stat.0 Request processed in 5380us (6412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947822.207174:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:2.0:1783947822.292227:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.292389:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214112128 00000100:00100000:0.0:1783947822.292668:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214112128 00000100:00100000:2.0:1783947822.292821:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:2.0:1783947822.292835:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+32:18872:x1870604214112128:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947822.292870:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947822.292920:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55502351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45c4 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947822.293161:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783947822.293305:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55502351 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45c4 expref: 34 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.293326:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:2.0:1783947822.293330:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947822.293336:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55502351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45c4 expref: 34 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.293355:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:2.0:1783947822.293452:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+33:18872:x1870604214112128:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 620us (1241us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1783947822.293512:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:1.0:1783947822.296987:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947822.297192:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214112384 00000100:00100000:2.0:1783947822.297206:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214112384 00000100:00100000:2.0:1783947822.297413:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1783947822.297428:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+33:18872:x1870604214112384:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947822.297795:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+34:18872:x1870604214112384:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 370us (823us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1783947822.297804:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:3.0:1783947822.349039:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947822.349158:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214112640 00000100:00100000:2.0:1783947822.349173:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214112640 00000100:00100000:2.0:1783947822.349265:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1783947822.349278:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+34:18878:x1870604214112640:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947822.349322:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947822.349353:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550235f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45cb expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.349718:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.349740:0:25709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 35 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.350003:0:25709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 35 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.350015:0:25709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.350135:0:25709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 35 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.350154:0:25709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 35 pid: 22662 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947822.350170:0:25709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1870604236234112:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947822.350447:0:25709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 35 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.350480:0:25709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 35 pid: 22661 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947822.350507:0:25709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1870604236234240:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947822.350579:0:25709:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947822.358709:0:25709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1870604236234112:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947822.358953:0:25709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25709:1870604236234240:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947822.358994:0:25709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947822.359048:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947822.359095:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.359608:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214112768 00000100:00100000:0.0:1783947822.359620:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214112768 00010000:00010000:0.0:1783947822.359688:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 36 pid: 22662 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947822.359735:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214112896 00000100:00100000:0.0:1783947822.359739:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214112896 00010000:00010000:0.0:1783947822.359754:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 37 pid: 22661 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947822.359792:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:0.0:1783947822.359803:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beb558050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f708495a-69fd-4413-8caa-ba048b1b3556+37:2407:x1870604214112768:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947822.359826:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947822.359835:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 37 pid: 22662 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.359873:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 37 pid: 22662 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.359903:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550234a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45bd expref: 37 pid: 22662 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.359924:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947822.359931:0:22648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.359944:0:22648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.359951:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947822.360174:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1783947822.360187:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f708495a-69fd-4413-8caa-ba048b1b3556+36:2407:x1870604214112896:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947822.360197:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947822.360203:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 36 pid: 22661 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.360214:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 36 pid: 22661 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.360229:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550228d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4585 expref: 36 pid: 22661 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.360255:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947822.360259:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.360268:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.360276:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.360300:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947822.360325:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f708495a-69fd-4413-8caa-ba048b1b3556+35:2407:x1870604214112896:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 142us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947822.360333:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00010000:00010000:2.0:1783947822.361850:0:25709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.361871:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947822.361899:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1783947822.362132:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550235f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 36 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.362158:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 35 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.362167:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947822.362171:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947822.362176:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b200, rc 0) 00000100:00100000:2.0:1783947822.362261:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+35:18878:x1870604214112640:12345-192.168.204.3@tcp:101:bash.0 Request processed in 12986us (13245us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1783947822.362272:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:0.0:1783947822.362574:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beb558050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f708495a-69fd-4413-8caa-ba048b1b3556+36:2407:x1870604214112768:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 220us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947822.362589:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947822.367202:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947822.367505:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214113152 00000100:00100000:2.0:1783947822.367518:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214113152 00000100:00100000:2.0:1783947822.367602:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:2.0:1783947822.367615:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+34:18878:x1870604214113152:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:2.0:1783947822.367977:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.368001:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.368016:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947822.368085:0:22663:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1783947822.368113:0:22663:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065118381 reply state 00000000b33dc7e7 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.368129:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.368138:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947822.368141:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947822.368146:0:22663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947822.368278:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+37:18878:x1870604214113152:12345-192.168.204.3@tcp:36:bash.0 Request processed in 665us (1089us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1783947822.368287:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000020:00080000:2.0:1783947822.368294:0:22663:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783947822.373347:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.373505:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214113280 00000100:00100000:0.0:1783947822.373519:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214113280 00000100:00100000:0.0:1783947822.373611:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1783947822.373625:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+37:18878:x1870604214113280:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947822.373660:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947822.373702:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550237b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45d2 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.373781:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550237b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45d2 expref: 38 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.373825:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550237b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45d2 expref: 38 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.373848:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947822.373851:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947822.373856:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51a00, rc 0) 00000100:00100000:0.0:1783947822.373937:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+38:18878:x1870604214113280:12345-192.168.204.3@tcp:101:bash.0 Request processed in 315us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947822.373946:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:3.0:1783947822.379902:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947822.380079:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214113408 00000100:00100000:2.0:1783947822.380092:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214113408 00000100:00100000:2.0:1783947822.380174:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1783947822.380187:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+38:18878:x1870604214113408:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947822.380240:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947822.380270:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55502382 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45d9 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.380615:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.380636:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 39 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.380648:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.380781:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 39 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.380798:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 39 pid: 25709 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947822.380814:0:22663:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22663:1870604236234368:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947822.380931:0:22663:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45aea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947822.384448:0:22663:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22663:1870604236234368:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947822.384531:0:22663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947822.385801:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947822.386005:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214113536 00000100:00100000:1.0:1783947822.386026:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214113536 00010000:00010000:1.0:1783947822.386079:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 40 pid: 25709 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947822.386125:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1783947822.386136:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f708495a-69fd-4413-8caa-ba048b1b3556+40:2407:x1870604214113536:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947822.386156:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947822.386165:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 40 pid: 25709 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.386179:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 40 pid: 25709 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.386228:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55502366 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45cb expref: 40 pid: 25709 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.386251:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947822.386256:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.386268:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.386277:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947822.386311:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947822.386387:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f708495a-69fd-4413-8caa-ba048b1b3556+39:2407:x1870604214113536:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 251us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947822.386396:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00010000:00010000:2.0:1783947822.386966:0:22663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.386978:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947822.387079:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783947822.387085:0:22663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947822.387112:0:22663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.387155:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55502382 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45d9 expref: 39 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.387175:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45d9 expref: 38 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.387184:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947822.387187:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947822.387190:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9be00, rc 0) 00000100:00100000:2.0:1783947822.387242:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+38:18878:x1870604214113408:12345-192.168.204.3@tcp:101:bash.0 Request processed in 7058us (7358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947822.387251:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:3.0:1783947822.392568:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947822.392708:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214113792 00000100:00100000:2.0:1783947822.392722:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214113792 00000100:00100000:2.0:1783947822.392800:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947822.392812:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+38:18878:x1870604214113792:12345-192.168.204.3@tcp:103:bash.0 00010000:00010000:2.0:1783947822.392833:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783947822.392868:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550237b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45d2 expref: 38 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.392899:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55502389 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45d9 expref: 37 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947822.392939:0:25691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947822.392946:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947822.393031:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+36:18878:x1870604214113792:12345-192.168.204.3@tcp:103:bash.0 Request processed in 212us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947822.393041:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1783947822.395874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.395983:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214113920 00000100:00100000:0.0:1783947822.395997:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214113920 00000100:00100000:0.0:1783947822.396083:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1783947822.396095:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+36:18878:x1870604214113920:12345-192.168.204.3@tcp:58:bash.0 00010000:00010000:0.0:1783947822.396267:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.396291:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.396306:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947822.397680:0:22662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947822.397727:0:22662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1783947822.397883:0:22662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1783947822.400172:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+36:18878:x1870604214113920:12345-192.168.204.3@tcp:58:bash.0 Request processed in 1930us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947822.400218:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1783947822.402884:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947822.403144:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214114048 00000100:00100000:0.0:1783947822.403156:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214114048 00000100:00100000:0.0:1783947822.403293:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1783947822.403307:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+36:18878:x1870604214114048:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947822.403337:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947822.403368:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.403440:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.403453:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 37 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.403499:0:22661:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.403516:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 37 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.403533:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947822.403548:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947822.403552:0:22661:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 37 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947822.403569:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51600, rc 0) 00000100:00100000:0.0:1783947822.403670:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+37:18878:x1870604214114048:12345-192.168.204.3@tcp:101:bash.0 Request processed in 366us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947822.403679:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00010000:00010000:3.0:1783947823.027757:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947823.347773:0:22697:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783947823.347786:0:22697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947823.347818:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1783947823.347829:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1783947823.348023:0:22697:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3cc5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22697:1870604236234496:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783947823.348392:0:22697:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947823.349569:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236234624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947823.349658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947823.349760:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236234624 00000100:00100000:3.0:1783947823.349772:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236234624 00000100:00100000:3.0:1783947823.349868:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947823.349880:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236234624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947823.349918:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947823.349978:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236234624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947823.349987:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947823.350018:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236234624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783947823.350099:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947823.352693:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.352717:0:22697:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3cc5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22697:1870604236234496:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947823.352990:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214114176 00000100:00100000:2.0:1783947823.352999:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214114176 00000100:00100000:2.0:1783947823.353070:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:2.0:1783947823.353081:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+37:18879:x1870604214114176:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947823.353136:0:25709:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947823.353275:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+37:18879:x1870604214114176:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 196us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.353281:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:3.0:1783947823.357662:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.359104:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214114304 00000100:00100000:2.0:1783947823.359124:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214114304 00000100:00100000:2.0:1783947823.359221:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:2.0:1783947823.359233:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+37:18879:x1870604214114304:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783947823.359349:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359373:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359409:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359431:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359440:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359446:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359530:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359543:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359550:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947823.359687:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783947823.359693:0:22663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947823.359710:0:22663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359723:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.359731:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360338:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360345:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9be00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947823.360350:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360359:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360376:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bfcba1100) 00010000:00010000:2.0:1783947823.360380:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947823.360385:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360392:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb5550239e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360415:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360420:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360425:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360429:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947823.360432:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360449:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360668:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9e7bfcba1700) 00010000:00010000:2.0:1783947823.360672:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947823.360676:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360686:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360706:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360712:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360718:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360724:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947823.360727:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360734:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360756:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947823.360759:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947823.360763:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.360780:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023ac lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947823.360916:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+37:18879:x1870604214114304:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 1680us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.360926:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1783947823.369298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.369525:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214114560 00000100:00100000:2.0:1783947823.369541:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214114560 00000100:00100000:2.0:1783947823.369643:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1783947823.369656:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+37:18879:x1870604214114560:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947823.369691:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947823.369720:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45e7 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.369891:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.369911:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.369925:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947823.369940:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947823.370052:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370061:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370088:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370099:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947823.370104:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370113:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370126:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947823.370130:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947823.370135:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370141:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555023ba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370188:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e7 expref: 39 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370198:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bfcba1100) 00010000:00010000:2.0:1783947823.370200:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947823.370204:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb555023b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e7 expref: 39 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.370213:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a400, rc 0) 00000100:00100000:2.0:1783947823.370299:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+38:18879:x1870604214114560:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 646us (1015us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1783947823.370324:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:3.0:1783947823.376789:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.376844:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214114688 00000100:00100000:2.0:1783947823.376858:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214114688 00000100:00100000:2.0:1783947823.376970:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1783947823.376983:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+38:18879:x1870604214114688:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947823.377029:0:22663:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947823.377178:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+38:18879:x1870604214114688:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 197us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.377186:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:3.0:1783947823.380801:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.380871:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214114944 00000100:00100000:2.0:1783947823.380885:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214114944 00000100:00100000:2.0:1783947823.381015:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:2.0:1783947823.381028:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+38:18879:x1870604214114944:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947823.381056:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947823.381082:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023c8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45ee expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947823.381689:0:25709:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1783947823.381698:0:25709:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1783947823.381724:0:25709:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1783947823.381906:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb555023cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.381926:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb555023cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.381938:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb555023cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25709 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.382025:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023c8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45ee expref: 41 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.382047:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb555023cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45ee expref: 40 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.382057:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7bfcba1700) 00010000:00010000:2.0:1783947823.382060:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947823.382064:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b400, rc 0) 00000100:00100000:2.0:1783947823.382153:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+40:18879:x1870604214114944:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1127us (1364us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1783947823.382163:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:3.0:1783947823.389247:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.389381:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214115200 00000100:00100000:0.0:1783947823.389394:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214115200 00000100:00100000:0.0:1783947823.389564:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1783947823.389578:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+40:18879:x1870604214115200:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783947823.389748:0:22661:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947823.389786:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b400/0xe6fd1fdb555023cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45ee expref: 40 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.389811:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7bfcba1700) 00010000:00010000:0.0:1783947823.389824:0:22661:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947823.389855:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.389873:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.389885:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.389927:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.389935:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.389943:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390021:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390030:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390037:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390045:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947823.390050:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390060:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390069:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947823.390072:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947823.390076:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390083:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555023dd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390102:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390108:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390114:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390120:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947823.390122:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390129:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390137:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x268bd028 (ffff9e7c003e9c00) 00010000:00010000:0.0:1783947823.390139:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947823.390142:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.390148:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb555023e4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x268bd028 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947823.390258:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+39:18879:x1870604214115200:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 683us (1026us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947823.390267:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:3.0:1783947823.392382:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.392504:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214115328 00000100:00100000:0.0:1783947823.392524:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214115328 00000100:00100000:0.0:1783947823.392601:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:0.0:1783947823.392630:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+39:18879:x1870604214115328:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947823.392835:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947823.392866:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555023eb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45f5 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.393022:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb555023f2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.393038:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb555023f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.393051:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb555023f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.393202:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb555023eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45f5 expref: 41 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.393224:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb555023f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45f5 expref: 40 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.393234:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:0.0:1783947823.393237:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947823.393242:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50a00, rc 0) 00000100:00100000:0.0:1783947823.393320:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+40:18879:x1870604214115328:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 694us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.393329:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:3.0:1783947823.397554:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.398114:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214115584 00000100:00100000:2.0:1783947823.398128:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214115584 00000100:00100000:2.0:1783947823.398206:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1783947823.398218:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+40:18879:x1870604214115584:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947823.398363:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.398384:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.398400:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947823.398679:0:22663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1783947823.398692:0:22663:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708626234466ns, next at 709626231606ns, rc = 0 00000004:00010000:2.0:1783947823.398765:0:22663:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000836460c4 reply state 00000000a371fea3 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.398781:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.398789:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:2.0:1783947823.398792:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783947823.398797:0:22663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947823.398930:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+42:18879:x1870604214115584:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 713us (1396us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1783947823.398939:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1783947823.401372:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.401542:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214115712 00000100:00100000:2.0:1783947823.401554:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214115712 00000100:00100000:2.0:1783947823.401666:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:2.0:1783947823.401679:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+42:18879:x1870604214115712:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947823.401714:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947823.401741:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e45fc expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.401814:0:25709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 43 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.401833:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 43 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.401858:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:2.0:1783947823.401862:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947823.401886:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a400, rc 0) 00000100:00100000:2.0:1783947823.401957:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+43:18879:x1870604214115712:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 282us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.401963:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:3.0:1783947823.404317:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.404430:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214115840 00000100:00100000:1.0:1783947823.404443:0:24673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214115840 00000100:00100000:1.0:1783947823.404566:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:1.0:1783947823.404581:0:24673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f708495a-69fd-4413-8caa-ba048b1b3556+5:2407:x1870604214115840:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783947823.405062:0:24673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f708495a-69fd-4413-8caa-ba048b1b3556+6:2407:x1870604214115840:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 485us (758us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1783947823.405071:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00080000:2.0:1783947823.405226:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947823.407159:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.407246:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214116096 00000100:00100000:1.0:1783947823.407257:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214116096 00000100:00100000:1.0:1783947823.407328:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1783947823.407339:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+43:18879:x1870604214116096:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783947823.407690:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+44:18879:x1870604214116096:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 351us (541us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1783947823.407699:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:3.0:1783947823.412801:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.413138:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214116352 00000100:00100000:0.0:1783947823.413151:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214116352 00000100:00100000:0.0:1783947823.413240:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:0.0:1783947823.413263:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+44:18879:x1870604214116352:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783947823.413437:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+44:18879:x1870604214116352:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 175us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.413446:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1783947823.416402:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.416722:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214116480 00000100:00100000:0.0:1783947823.416736:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214116480 00000100:00100000:0.0:1783947823.416868:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:0.0:1783947823.416880:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+44:18879:x1870604214116480:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947823.416910:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947823.416941:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502407 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4603 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.417141:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550240e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.417159:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550240e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.417174:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550240e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947823.417236:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947823.417261:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550240e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.417293:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502407 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4603 expref: 46 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.417317:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550240e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4603 expref: 45 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.417335:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:0.0:1783947823.417339:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947823.417343:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51a00, rc 0) 00000100:00100000:0.0:1783947823.417431:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+45:18879:x1870604214116480:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 553us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.417441:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:3.0:1783947823.420697:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.421225:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214116608 00000100:00100000:1.0:1783947823.421239:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214116608 00000100:00100000:1.0:1783947823.421356:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:1.0:1783947823.421368:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bee962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+6:2407:x1870604214116608:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947823.421392:0:24167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947823.421418:0:24167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e460a expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947823.421450:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e22e, blocks: 0x0 00010000:00010000:1.0:1783947823.421530:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=708s v=(0 0) 00010000:00010000:1.0:1783947823.421536:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947823.421549:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 7 pid: 24167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.421574:0:24167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 7 pid: 24167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.421592:0:24167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438600, rc 0) 00000100:00100000:1.0:1783947823.421680:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bee962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:2407:x1870604214116608:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 315us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.421706:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1783947823.424134:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.424630:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214116864 00000100:00100000:0.0:1783947823.424643:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214116864 00000100:00100000:0.0:1783947823.424768:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:0.0:1783947823.424780:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+45:18879:x1870604214116864:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783947823.424940:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+45:18879:x1870604214116864:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 162us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.424948:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1783947823.427135:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.427860:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214116992 00000100:00100000:1.0:1783947823.427873:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214116992 00000100:00100000:1.0:1783947823.427954:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:1.0:1783947823.427967:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+45:18879:x1870604214116992:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783947823.430700:0:22641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:0.0:1783947823.430728:0:22641:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783947823.430798:0:22641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1783947823.431038:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.431055:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.431065:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.431072:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d51600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947823.431078:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.431104:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.431130:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:0.0:1783947823.431134:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783947823.431141:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.431148:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d51600/0xe6fd1fdb5550222b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947823.431195:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236234752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783947823.431291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947823.431376:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236234752 00000100:00100000:0.0:1783947823.431388:0:24673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236234752 00000100:00100000:0.0:1783947823.431514:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947823.431537:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236234752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783947823.431741:0:24170:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783947823.431745:0:24170:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783947823.431748:0:24170:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783947823.431750:0:24170:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783947822 -> 1783947822 00002000:00010000:0.0:1783947823.431753:0:24170:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783947823.431804:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236234752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (513us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1783947823.431812:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1783947823.431871:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7be3cc5500/2, rc 0, transno 12884901892 00000100:00100000:0.0:1783947823.431879:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236234752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783947823.432059:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+20:18879:x1870604214116992:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 4092us (4933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.432068:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00010000:00010000:3.0:1783947823.432787:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432801:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432810:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432817:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.432822:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432830:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432848:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e7c003e9d00) 00010000:00010000:3.0:1783947823.432852:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.432857:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432864:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555021d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432890:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432896:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432917:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432922:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.432925:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432932:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432940:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:3.0:1783947823.432943:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.432946:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432953:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555021de lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432969:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432975:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432981:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.432986:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.432988:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433069:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433079:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e7c003e5d00) 00010000:00010000:3.0:1783947823.433082:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.433085:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433091:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502286 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433109:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433116:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433122:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433128:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.433131:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433137:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433145:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947823.433148:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.433151:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433168:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50e00/0xe6fd1fdb5550230b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433183:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433190:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433196:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433201:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.433204:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433210:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433219:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947823.433221:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.433223:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433229:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550232e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433240:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433247:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433259:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433264:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.433268:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433274:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433283:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947823.433285:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.433288:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433294:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502374 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433307:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433314:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433320:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433326:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9be00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.433329:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433344:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433353:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:3.0:1783947823.433356:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783947823.433359:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.433365:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555023f9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783947823.435802:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947823.436398:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.436867:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214117120 00000100:00100000:0.0:1783947823.436884:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214117120 00000100:00100000:0.0:1783947823.436987:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:0.0:1783947823.437010:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+7:2407:x1870604214117120:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783947823.437170:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+7:2407:x1870604214117120:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 172us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.437180:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:3.0:1783947823.439366:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.439433:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214117376 00000100:00100000:1.0:1783947823.439448:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214117376 00000100:00100000:1.0:1783947823.439634:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:1.0:1783947823.439646:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+14:18879:x1870604214117376:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947823.439722:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947823.439802:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550240e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4603 expref: 14 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.439829:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:1.0:1783947823.439835:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947823.439878:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550241c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.439896:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550241c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.439907:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550241c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947823.440113:0:22662:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b3c0ae7 reply state 000000001428618e transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550241c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.440125:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb5550241c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.440247:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:1.0:1783947823.440249:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947823.440252:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947823.440372:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+15:18879:x1870604214117376:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 727us (1016us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1783947823.440380:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1783947823.442348:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.442413:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214117504 00000100:00100000:0.0:1783947823.442431:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214117504 00000100:00100000:0.0:1783947823.442535:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:0.0:1783947823.442546:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+7:18879:x1870604214117504:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947823.442571:0:24170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947823.442594:0:24170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4611 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.442635:0:24170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.442643:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947823.442647:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947823.442650:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 8 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.442707:0:24170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.442722:0:24170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947823.442739:0:24170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24170:1870604236234880:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947823.442840:0:24170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947823.446319:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.446444:0:24170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3cc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24170:1870604236234880:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947823.446542:0:24170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 8 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.446571:0:24170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50400, rc 0) 00000100:00100000:0.0:1783947823.446649:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f708495a-69fd-4413-8caa-ba048b1b3556+8:18879:x1870604214117504:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 4096us (4302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.446660:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:1.0:1783947823.447333:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214117632 00000100:00100000:1.0:1783947823.447345:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214117632 00010000:00010000:1.0:1783947823.447395:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.447554:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1783947823.447568:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f708495a-69fd-4413-8caa-ba048b1b3556+8:2407:x1870604214117632:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947823.447589:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947823.447627:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.447660:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.447695:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1b02c9/0xe6fd1fdb55502415 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e460a expref: 8 pid: 24167 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.447715:0:22647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947823.447720:0:22647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947823.447750:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 7 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.447762:0:22647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 7 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.447816:0:22647:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 7 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.447834:0:22647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22647:1870604236235008:192.168.204.3@tcp:105: 00000100:00100000:1.0:1783947823.447937:0:22647:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7d56840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947823.450748:0:22647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22647:1870604236235008:192.168.204.3@tcp:105: 00010000:00010000:1.0:1783947823.450788:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947823.450864:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f708495a-69fd-4413-8caa-ba048b1b3556+7:2407:x1870604214117632:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 3298us (4560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.450877:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:0.0:1783947823.451552:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.451838:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214117760 00000100:00100000:1.0:1783947823.451847:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214117760 00000100:00100000:1.0:1783947823.451916:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:1.0:1783947823.451927:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+7:2406:x1870604214117760:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783947823.452170:0:24167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783947823.452175:0:24167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1783947821 00002000:00010000:1.0:1783947823.452177:0:24167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1783947819 00002000:00010000:1.0:1783947823.452180:0:24167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1783947822 -> 1783947821 00002000:00010000:1.0:1783947823.452182:0:24167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783947823.452246:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+8:2406:x1870604214117760:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 320us (697us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1783947823.452279:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:0.0:1783947823.455386:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.455532:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214117888 00000100:00100000:2.0:1783947823.455547:0:24673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214117888 00000100:00100000:2.0:1783947823.455670:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:2.0:1783947823.455685:0:24673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f708495a-69fd-4413-8caa-ba048b1b3556+8:2407:x1870604214117888:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783947823.455762:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.455792:0:24673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 8 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.455803:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947823.455809:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947823.455814:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.455862:0:24673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 8 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.455879:0:24673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 8 pid: 24170 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947823.455917:0:24673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24673:1870604236235136:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947823.456100:0:24673:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45ae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947823.460769:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.461044:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214118016 00000100:00100000:1.0:1783947823.461058:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214118016 00010000:00010000:1.0:1783947823.461121:0:25691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 9 pid: 24170 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.461176:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1783947823.461178:0:24673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24673:1870604236235136:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947823.461186:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+9:2407:x1870604214118016:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947823.461206:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947823.461214:0:24673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.461235:0:25691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 9 pid: 24170 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.461250:0:25691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 9 pid: 24170 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.461279:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55502423 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4611 expref: 9 pid: 24170 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.461302:0:25691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947823.461307:0:25691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947823.461314:0:25691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.461325:0:25691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.461389:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947823.461562:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+8:2407:x1870604214118016:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 376us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.461571:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00010000:00010000:2.0:1783947823.461739:0:24673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461750:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461777:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461786:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461796:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461804:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9be00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947823.461809:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461831:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461845:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.461853:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004124e569/0xe6fd1fdb5550242a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947823.461928:0:24673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f708495a-69fd-4413-8caa-ba048b1b3556+7:2407:x1870604214117888:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 6246us (6561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.461938:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1783947823.464269:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.466367:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214118272 00000100:00100000:0.0:1783947823.466388:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214118272 00000100:00100000:0.0:1783947823.466723:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:0.0:1783947823.466736:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+15:18879:x1870604214118272:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783947823.466865:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.466905:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 15 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.466917:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.466962:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 15 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.466977:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 15 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947823.466994:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3cc5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236235264:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947823.467249:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947823.471605:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.471868:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3cc5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236235264:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947823.471905:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947823.472143:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214118400 00000100:00100000:2.0:1783947823.472153:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214118400 00010000:00010000:2.0:1783947823.472202:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947823.472281:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:2.0:1783947823.472292:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f708495a-69fd-4413-8caa-ba048b1b3556+16:2406:x1870604214118400:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947823.472311:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947823.472319:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472331:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472378:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b000/0xe6fd1fdb55502304 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45af expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472398:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947823.472404:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 15 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472415:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472423:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472433:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.472497:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947823.472570:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f708495a-69fd-4413-8caa-ba048b1b3556+15:2406:x1870604214118400:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 279us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.472579:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00010000:00010000:0.0:1783947823.473093:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.473105:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.473421:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.473439:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 15 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.473487:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.473557:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 15 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.473573:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 15 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947823.473591:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3cc5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236235392:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947823.473691:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc11ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947823.477135:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3cc5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236235392:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947823.477178:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947823.478236:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.478778:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214118528 00000100:00100000:1.0:1783947823.478794:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214118528 00010000:00010000:1.0:1783947823.478861:0:25691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.478926:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1783947823.478937:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beb55a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+16:2406:x1870604214118528:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947823.478963:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947823.478972:0:25691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.478988:0:25691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.479028:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a400/0xe6fd1fdb55502400 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45fc expref: 16 pid: 25709 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.479048:0:25691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:1.0:1783947823.479055:0:25691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.479218:0:25691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.479254:0:25691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.479402:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947823.479556:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beb55a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f708495a-69fd-4413-8caa-ba048b1b3556+15:2406:x1870604214118528:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 618us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.479565:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00010000:00010000:2.0:1783947823.480183:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.480195:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947823.480358:0:22661:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1783947823.480548:0:22661:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1783947823.480590:0:22661:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1783947823.480734:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22661:1870604236235520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783947823.480808:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947823.480847:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947823.481047:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236235520 00000100:00100000:1.0:1783947823.481055:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236235520 00000100:00100000:1.0:1783947823.481118:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947823.481129:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22661:x1870604236235520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783947823.481240:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22661:x1870604236235520:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.481248:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947823.481437:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22661:1870604236235520:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783947823.481720:0:22661:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1783947823.481783:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22661:1870604236235648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783947823.481818:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947823.481898:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45ae000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947823.482977:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236235648 00000100:00100000:3.0:1783947823.482990:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236235648 00000100:00100000:3.0:1783947823.483070:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947823.483082:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22661:x1870604236235648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783947823.483577:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22661:x1870604236235648:12345-0@lo:1000:mdt00_000.0 Request processed in 495us (1755us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1783947823.483586:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783947823.483724:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22661:1870604236235648:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783947823.483780:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483790:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483795:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483799:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947823.483804:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483810:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483826:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:2.0:1783947823.483828:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947823.483832:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483855:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb55502438 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483890:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483893:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483897:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483901:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947823.483902:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483906:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483911:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:2.0:1783947823.483912:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947823.483919:0:22661:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 18 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483928:0:22661:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 18 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.483934:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 18 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.484077:0:22661:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55502397 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e45e0 expref: 18 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947823.484097:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236235776:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947823.484215:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc45ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947823.488419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.488549:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22661:1870604236235776:192.168.204.3@tcp:105: 00000100:00100000:1.0:1783947823.488578:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214118656 00000100:00100000:1.0:1783947823.488586:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214118656 00010000:00010000:2.0:1783947823.488594:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.488606:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55502390 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.488670:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:1.0:1783947823.488682:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+19:18878:x1870604214118656:12345-192.168.204.3@tcp:49:bash.0 00010000:00010000:3.0:1783947823.488842:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.488870:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f708495a-69fd-4413-8caa-ba048b1b3556+19:18878:x1870604214118656:12345-192.168.204.3@tcp:49:bash.0 Request processed in 190us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.488877:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00010000:00010000:3.0:1783947823.488885:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488900:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488913:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488924:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488931:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488938:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.488942:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488949:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488960:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947823.488963:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947823.488967:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488973:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d50200/0xe6fd1fdb5550243f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.488983:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.489076:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.489085:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.489090:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947823.489092:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.489098:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.489106:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:3.0:1783947823.489108:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783947823.489111:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947823.489117:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55502431 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947823.489349:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+18:18879:x1870604214118272:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 22615us (25094us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1783947823.489358:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00000020:00080000:3.0:1783947823.489362:0:22661:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783947823.490699:0:22697:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783947823.490711:0:22697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947823.490746:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1783947823.490757:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1783947823.495395:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947823.495600:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.495656:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214118784 00000100:00100000:0.0:1783947823.495671:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214118784 00000100:00100000:2.0:1783947823.495713:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214119040 00000100:00100000:2.0:1783947823.495719:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214119040 00000100:00100000:2.0:1783947823.495762:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:2.0:1783947823.495772:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+18:18879:x1870604214119040:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947823.496068:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:0.0:1783947823.496080:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+7:18878:x1870604214118784:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947823.496095:0:24169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947823.496126:0:24169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb55502446 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4618 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947823.496132:0:22665:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783947823.496175:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00002000:00010000:0.0:1783947823.496190:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a54e22d, atime: 0x6a54e22b, ctime: 0x6a54e22d, blocks: 0x0 00010000:00010000:2.0:1783947823.496209:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.496218:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1783947823.496226:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947823.496229:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.496239:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb55502446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4618 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496244:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496260:0:22665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.496266:0:24169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb55502446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4618 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496285:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496295:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.496295:0:24169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51e00, rc 0) 00010000:00010000:2.0:1783947823.496322:0:22665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783947823.496374:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f708495a-69fd-4413-8caa-ba048b1b3556+8:18878:x1870604214118784:12345-192.168.204.3@tcp:101:bash.0 Request processed in 297us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947823.496383:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+20:18879:x1870604214119040:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 610us (1004us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1783947823.496387:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1783947823.496397:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000020:00080000:2.0:1783947823.496403:0:22665:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783947823.496431:0:24195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947823.496438:0:24195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496446:0:24195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947823.496450:0:24195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496491:0:24195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496506:0:24195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e7c003e9300) 00010000:00010000:2.0:1783947823.496509:0:24195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783947823.496526:0:24195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496534:0:24195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb5550244d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.496559:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947823.496562:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947823.496564:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947823.512174:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947823.512358:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214119168 00000100:00100000:0.0:1783947823.512371:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214119168 00000100:00100000:0.0:1783947823.512446:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1783947823.512493:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+20:18878:x1870604214119168:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947823.512537:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947823.512566:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55502454 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e461f expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.512609:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550245b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.512628:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550245b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.512669:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550245b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.514309:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55502454 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e461f expref: 22 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.514346:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550245b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e461f expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947823.514357:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:0.0:1783947823.514360:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947823.514364:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51a00, rc 0) 00000100:00100000:0.0:1783947823.514815:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f708495a-69fd-4413-8caa-ba048b1b3556+21:18878:x1870604214119168:12345-192.168.204.3@tcp:101:bash.0 Request processed in 2356us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947823.514826:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1783947823.522945:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.523152:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214119424 00000100:00100000:2.0:1783947823.523167:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214119424 00000100:00100000:2.0:1783947823.523284:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:2.0:1783947823.523297:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+21:18878:x1870604214119424:12345-192.168.204.3@tcp:35:bash.0 00000001:00080000:2.0:1783947823.523654:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1783947823.523803:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1783947823.524204:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+24:18878:x1870604214119424:12345-192.168.204.3@tcp:35:bash.0 Request processed in 906us (1271us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1783947823.524215:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000020:00080000:2.0:1783947823.524221:0:22665:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783947823.624121:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.628125:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214119680 00000100:00100000:2.0:1783947823.628162:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214119680 00000100:00100000:2.0:1783947823.628282:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:2.0:1783947823.628295:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+24:18889:x1870604214119680:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947823.628331:0:25709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947823.628364:0:25709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4626 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947823.628621:0:25709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783947823.628762:0:25709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502462 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4626 expref: 26 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.628781:0:25709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd56eb900) 00010000:00010000:2.0:1783947823.628803:0:25709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947823.628809:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a600/0xe6fd1fdb55502462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4626 expref: 26 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947823.628824:0:25709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a600, rc 0) 00000100:00100000:2.0:1783947823.628921:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f708495a-69fd-4413-8caa-ba048b1b3556+25:18889:x1870604214119680:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 629us (4814us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1783947823.628929:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:3.0:1783947823.640623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947823.642365:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214119808 00000100:00100000:1.0:1783947823.642384:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214119808 00000100:00100000:1.0:1783947823.642709:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:1.0:1783947823.642722:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+25:18889:x1870604214119808:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1783947823.642903:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643003:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643020:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643051:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643058:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643064:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643166:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643175:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643182:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947823.643242:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643257:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.643263:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.644958:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.644981:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947823.644987:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.644998:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645020:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e7c003e9f00) 00010000:00010000:1.0:1783947823.645023:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947823.645030:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645039:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb55502470 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645063:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645069:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645076:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645080:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947823.645136:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645167:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645176:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e7c003e5500) 00010000:00010000:1.0:1783947823.645178:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947823.645181:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645188:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55502477 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645211:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645217:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645223:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645229:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947823.645231:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645237:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645244:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e7c003e5800) 00010000:00010000:1.0:1783947823.645246:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947823.645249:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947823.645264:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550247e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947823.645408:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f708495a-69fd-4413-8caa-ba048b1b3556+25:18889:x1870604214119808:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 2682us (4796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947823.645421:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:0.0:1783947823.654267:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947823.654420:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120064 00000100:00100000:2.0:1783947823.654435:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120064 00000100:00100000:2.0:1783947823.654542:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:2.0:1783947823.654555:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+25:18889:x1870604214120064:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947823.654897:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f708495a-69fd-4413-8caa-ba048b1b3556+26:18889:x1870604214120064:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 344us (646us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1783947823.654905:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00010000:00010000:3.0:1783947824.051703:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947824.371690:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947824.371810:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236236160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947824.371912:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236236032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947824.371923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947824.371964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.376082:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236235904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947824.376229:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236160 00000100:00100000:0.0:1783947824.376240:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236160 00000100:00100000:0.0:1783947824.376339:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947824.376352:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236236160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947824.376386:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947824.376493:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236236160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (4573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947824.376511:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783947824.376571:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947824.377974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.378071:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236236160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947824.378177:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236032 00000100:00100000:1.0:1783947824.378186:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236032 00000100:00100000:1.0:1783947824.378235:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236235904 00000100:00100000:1.0:1783947824.378237:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236235904 00000100:00100000:1.0:1783947824.378251:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783947824.378258:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236236032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947824.378299:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1783947824.378398:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236236032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (6434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947824.378404:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783947824.378417:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947824.378422:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236235904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947824.378441:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783947824.378521:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236235904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947824.378528:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947824.378564:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236235904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947824.378869:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236236032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947824.883720:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947824.883812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.883877:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236288 00000100:00100000:2.0:1783947824.883897:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236288 00000100:00100000:2.0:1783947824.883971:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947824.884206:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870604236236288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947824.884239:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1783947824.884289:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870604236236288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.884297:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947824.884351:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947824.884867:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236236416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947824.884903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947824.885190:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236416 00000100:00100000:1.0:1783947824.885196:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236416 00000100:00100000:1.0:1783947824.885240:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947824.885248:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236236416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947824.885267:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1783947824.885304:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236236416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947824.885311:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783947824.885328:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947824.885357:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236236416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947824.885590:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236236544:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.885626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.885655:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236237056:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.885679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.885693:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236237568:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.885713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.885732:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783947824.885737:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236236672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.885842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.885864:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236237184:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.885888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.885905:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236237696:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886335:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237056 00000100:00100000:1.0:1783947824.886343:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237056 00000100:00100000:1.0:1783947824.886379:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236672 00000100:00100000:1.0:1783947824.886382:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236672 00000100:00100000:1.0:1783947824.886398:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947824.886407:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236237056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886477:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236237056:12345-0@lo:400:kworker.0 Request processed in 71us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947824.886484:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947824.886509:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947824.886515:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236236672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886546:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236236672:12345-0@lo:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947824.886553:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947824.886572:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236236928:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947824.886618:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236237440:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947824.886675:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783947824.886681:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236236800:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947824.886723:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236237312:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.886741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.887154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947824.887186:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236237056:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887210:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236236672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887235:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236544 00000100:00100000:2.0:1783947824.887248:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236544 00000100:00100000:2.0:1783947824.887280:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783947824.887286:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3637:x1870604236236544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887327:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39423f5f-9729-4dc0-9c01-dc528f57ea81+24:3637:x1870604236236544:12345-0@lo:400:kworker.0 Request processed in 41us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887334:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783947824.887366:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237568 00000100:00100000:2.0:1783947824.887369:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237568 00000100:00100000:2.0:1783947824.887399:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236928 00000100:00100000:2.0:1783947824.887401:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236928 00000100:00100000:2.0:1783947824.887413:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237440 00000100:00100000:2.0:1783947824.887415:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237440 00000100:00100000:2.0:1783947824.887426:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237312 00000100:00100000:2.0:1783947824.887428:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237312 00000100:00100000:2.0:1783947824.887437:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237696 00000100:00100000:2.0:1783947824.887439:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237696 00000100:00100000:2.0:1783947824.887450:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783947824.887471:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236237568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887517:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236237568:12345-0@lo:400:kworker.0 Request processed in 60us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887523:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783947824.887535:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947824.887540:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236236928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887568:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236236928:12345-0@lo:400:kworker.0 Request processed in 28us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887574:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947824.887585:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947824.887591:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236237440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887629:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236237440:12345-0@lo:400:kworker.0 Request processed in 38us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887635:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947824.887646:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783947824.887651:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236237312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887676:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236237312:12345-0@lo:400:kworker.0 Request processed in 24us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887681:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783947824.887692:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947824.887697:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236237696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887719:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236237696:12345-0@lo:400:kworker.0 Request processed in 23us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887725:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947824.887749:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237184 00000100:00100000:2.0:1783947824.887753:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237184 00000100:00100000:2.0:1783947824.887793:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236236800 00000100:00100000:2.0:1783947824.887796:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236236800 00000100:00100000:2.0:1783947824.887812:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947824.887816:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236237184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887848:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236237184:12345-0@lo:400:kworker.0 Request processed in 31us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887853:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947824.887864:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947824.887869:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236236800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.887893:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236236800:12345-0@lo:400:kworker.0 Request processed in 24us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947824.887907:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783947824.889505:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947824.889525:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947824.890499:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236237824:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.890594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947824.890636:0:25709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236237824 00000100:00100000:1.0:1783947824.890643:0:25709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236237824 00000100:00100000:1.0:1783947824.890700:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947824.890710:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236237824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.890761:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236237824:12345-0@lo:400:kworker.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947824.890768:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783947824.890791:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783947824.890820:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac842ca80 x1870604236237824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947824.890834:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236237824:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.890850:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236236928:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.890861:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236237440:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.890890:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236236800:0@lo:400:kworker.0 00000100:00100000:1.0:1783947824.890902:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236237312:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.892141:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236237184:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.892166:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236237696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947824.892178:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39423f5f-9729-4dc0-9c01-dc528f57ea81:3637:1870604236236544:0@lo:400:kworker.0 00010000:00080000:2.0:1783947824.892191:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac842ea00 x1870604236237568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947824.892202:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236237568:0@lo:400:kworker.0 00010000:00010000:3.0:1783947825.077138:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947825.368829:0:25746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1783947826.100025:0:24195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947826.161840:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.161885:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.161916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.161948:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.161971:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.162010:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.162029:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.162044:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.162062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947826.162089:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120704 00000100:00100000:3.0:1783947826.162098:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120704 00000100:00100000:3.0:1783947826.162148:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214121216 00000100:00100000:3.0:1783947826.162151:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214121216 00000100:00100000:3.0:1783947826.162169:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120576 00000100:00100000:3.0:1783947826.162171:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120576 00000100:00100000:3.0:1783947826.162189:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214121088 00000100:00100000:3.0:1783947826.162192:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214121088 00000100:00100000:3.0:1783947826.162217:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:0.0:1783947826.162225:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120448 00000100:00100000:3.0:1783947826.162229:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+8:2409:x1870604214120704:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947826.162240:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120448 00000100:00100000:0.0:1783947826.162299:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120960 00000100:00100000:0.0:1783947826.162302:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120960 00000100:00100000:3.0:1783947826.162319:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+8:2409:x1870604214120704:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947826.162322:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120320 00000100:00100000:0.0:1783947826.162327:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120320 00000100:00100000:0.0:1783947826.162339:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120832 00000100:00100000:0.0:1783947826.162342:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120832 00000100:00100000:3.0:1783947826.162353:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:0.0:1783947826.162367:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1783947826.162382:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+5:2409:x1870604214120448:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947826.162386:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1783947826.162407:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2409:x1870604214121216:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947826.162507:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2409:x1870604214121216:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 111us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947826.162526:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:0.0:1783947826.162542:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+5:2409:x1870604214120448:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 163us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947826.162550:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1783947826.162565:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:3.0:1783947826.162572:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+5:2408:x1870604214120576:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947826.162594:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:0.0:1783947826.162605:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2409:x1870604214120960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947826.162617:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+5:2408:x1870604214120576:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 49us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947826.162627:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1783947826.162646:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2409:x1870604214120960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 42us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947826.162657:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:0.0:1783947826.162664:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:3.0:1783947826.162671:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2408:x1870604214121088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947826.162686:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:0.0:1783947826.162706:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+26:2408:x1870604214120320:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947826.162720:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4aec5925-d4b7-4c93-a83c-72b2db0b1155+5:2408:x1870604214121088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 43us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947826.162732:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:0.0:1783947826.162763:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f708495a-69fd-4413-8caa-ba048b1b3556+26:2408:x1870604214120320:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 67us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947826.162772:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1783947826.162794:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:1.0:1783947826.162860:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214120192 00000100:00100000:1.0:1783947826.162866:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214120192 00000100:00100000:1.0:1783947826.162898:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:1.0:1783947826.162905:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:2409:x1870604214120192:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947826.162940:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5eb1973-6d1a-4b8c-987a-a82ce9b8d600+13:2409:x1870604214120192:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947826.162946:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00080000:1.0:1783947826.162981:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947826.162985:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947826.162988:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947826.162990:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947826.164581:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2408:x1870604214120832:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947826.165290:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4aec5925-d4b7-4c93-a83c-72b2db0b1155+6:2408:x1870604214120832:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2483us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947826.165300:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000040:00080000:0.0:1783947826.547656:0:22697:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783947826.547667:0:22697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947826.547689:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1783947826.547713:0:22697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1783947827.127530:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947827.183056:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947827.183102:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947827.183163:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214121472 00000100:00100000:2.0:1783947827.183172:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214121472 00000100:00100000:2.0:1783947827.183231:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1783947827.183241:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+8:2408:x1870604214121472:12345-192.168.204.3@tcp:16:kworker.0 00000100:00100000:2.0:1783947827.183360:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f708495a-69fd-4413-8caa-ba048b1b3556+8:2408:x1870604214121472:12345-192.168.204.3@tcp:16:kworker.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947827.183368:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:0.0:1783947827.185953:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214121344 00000100:00100000:0.0:1783947827.185968:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214121344 00002000:00100000:0.0:1783947827.186018:0:24173:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9e7befed8e00 x1870604214121344/t0(0) o4->f708495a-69fd-4413-8caa-ba048b1b3556@192.168.204.3@tcp:618/0 lens 504/0 e 0 to 0 dl 1783947838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1783947827.186032:0:24173:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7befed8e00 with x1870604214121344 ext(0->8) 00002000:00010000:0.0:1783947827.186038:0:24173:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e7befed8e00 00000100:00100000:0.0:1783947827.186075:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1783947827.186084:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f708495a-69fd-4413-8caa-ba048b1b3556+8:2408:x1870604214121344:12345-192.168.204.3@tcp:4:bash.0 00000100:00100000:1.0:1783947827.189287:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f708495a-69fd-4413-8caa-ba048b1b3556+10:2408:x1870604214121344:12345-192.168.204.3@tcp:4:bash.0 Request processed in 3195us (6233us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1783947827.189306:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00002000:00100000:1.0:1783947827.189318:0:24173:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9e7befed8e00 x1870604214121344/t12884901895(0) o4->f708495a-69fd-4413-8caa-ba048b1b3556@192.168.204.3@tcp:618/0 lens 504/448 e 0 to 0 dl 1783947838 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1783947827.189331:0:24173:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7befed8e00 with x1870604214121344 ext(0->8) 00002000:00010000:1.0:1783947827.189337:0:24173:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e7befed8e00 Debug log: 14256 lines, 14256 kept, 0 dropped, 0 bad.