00000100:00100000:0.0F:1787830220.464178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830220.464259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0F:1787830220.464371:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295732736 00000100:00100000:2.0:1787830220.464387:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295732736 00000100:00100000:3.0F:1787830220.464509:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295732608 00000100:00100000:3.0:1787830220.464519:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295732608 00002000:00100000:3.0:1787830220.464589:0:18604:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9f25b7c6b480 x1874675295732608/t0(0) o4->93d0e849-5afb-403c-9ad8-4a7bedf3d526@192.168.204.30@tcp:46/0 lens 504/0 e 0 to 0 dl 1787830231 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00000100:00100000:2.0:1787830220.464597:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00002000:00100000:3.0:1787830220.464602:0:18604:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f25b7c6b480 with x1874675295732608 ext(0->8) 00002000:00010000:3.0:1787830220.464609:0:18604:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f25b7c6b480 00000100:00100000:2.0:1787830220.464611:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d0e849-5afb-403c-9ad8-4a7bedf3d526+9:2393:x1874675295732736:12345-192.168.204.30@tcp:16:kworker.0 00000100:00100000:3.0:1787830220.464627:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1787830220.464708:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+9:2393:x1874675295732608:12345-192.168.204.30@tcp:4:bash.0 00000100:00100000:2.0:1787830220.464782:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:93d0e849-5afb-403c-9ad8-4a7bedf3d526+9:2393:x1874675295732736:12345-192.168.204.30@tcp:16:kworker.0 Request processed in 174us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830220.464790:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1787830220.468828:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+10:2393:x1874675295732608:12345-192.168.204.30@tcp:4:bash.0 Request processed in 4175us (4643us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787830220.468844:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:3.0:1787830220.468859:0:18604:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9f25b7c6b480 x1874675295732608/t8589934599(0) o4->93d0e849-5afb-403c-9ad8-4a7bedf3d526@192.168.204.30@tcp:46/0 lens 504/448 e 0 to 0 dl 1787830231 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787830220.468872:0:18604:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f25b7c6b480 with x1874675295732608 ext(0->8) 00002000:00010000:3.0:1787830220.468889:0:18604:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f25b7c6b480 00000100:00080000:0.0:1787830220.474805:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830220.545281:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830220.555788:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316782976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830220.555919:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830220.560025:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316782976 00000100:00100000:0.0:1787830220.560041:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316782976 00000100:00100000:1.0F:1787830220.560228:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787830220.560249:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316782976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830220.560299:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787830220.560470:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316782976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 223us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830220.560478:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787830220.560593:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316782976:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787830220.990847:0:17128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787830220.990857:0:17128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787830220.990884:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787830220.990892:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787830221.308991:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830221.565316:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316783104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830221.565394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.565672:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783104 00000100:00100000:0.0:1787830221.565680:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783104 00000100:00100000:0.0:1787830221.565760:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830221.565770:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316783104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787830221.565794:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787830221.565840:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316783104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.565848:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830221.565872:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316783360:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.565898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.565925:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316783872:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.565948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.565966:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874675316784384:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.565989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566008:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787830221.566015:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316783488:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566055:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316784000:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566106:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483cd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874675316784512:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787830221.566157:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830221.566170:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783360 00000100:00100000:0.0:1787830221.566186:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783360 00000100:00100000:0.0:1787830221.566209:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783872 00000100:00100000:0.0:1787830221.566212:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783872 00000100:00100000:0.0:1787830221.566226:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787830221.566233:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316783360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566274:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316783360:12345-0@lo:400:kworker.0 Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.566280:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787830221.566293:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787830221.566299:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566327:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316783872:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.566333:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787830221.566355:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784384 00000100:00100000:0.0:1787830221.566358:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784384 00000100:00100000:0.0:1787830221.566390:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784512 00000100:00100000:0.0:1787830221.566393:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784512 00000100:00100000:0.0:1787830221.566413:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787830221.566420:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874675316784384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566450:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874675316784384:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.566457:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787830221.566467:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787830221.566473:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874675316784512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566508:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874675316784512:12345-0@lo:400:kworker.0 Request processed in 35us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.566514:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787830221.566534:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783488 00000100:00100000:0.0:1787830221.566537:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783488 00000100:00100000:0.0:1787830221.566563:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784000 00000100:00100000:0.0:1787830221.566566:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784000 00000100:00100000:0.0:1787830221.566586:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830221.566592:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316783488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566623:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316783488:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.566628:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830221.566638:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787830221.566644:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316784000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566669:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316784000:12345-0@lo:400:kworker.0 Request processed in 25us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.566674:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787830221.566707:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316783232:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566758:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566781:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316783744:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566813:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874675316784256:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566849:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787830221.566855:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316783616:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566899:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316784128:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566940:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483cda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874675316784640:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.566959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830221.566978:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783232 00000100:00100000:0.0:1787830221.566982:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783232 00000100:00100000:0.0:1787830221.567056:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787830221.567063:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316783232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567097:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316783232:12345-0@lo:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.567104:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787830221.567130:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783744 00000100:00100000:0.0:1787830221.567133:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783744 00000100:00100000:0.0:1787830221.567149:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784256 00000100:00100000:0.0:1787830221.567152:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784256 00000100:00100000:0.0:1787830221.567164:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784128 00000100:00100000:0.0:1787830221.567167:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784128 00000100:00100000:0.0:1787830221.567191:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784640 00000100:00100000:0.0:1787830221.567194:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784640 00000100:00100000:0.0:1787830221.567209:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787830221.567216:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316783744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567247:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316783744:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.567252:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787830221.567264:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787830221.567270:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874675316784256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567297:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874675316784256:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.567309:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787830221.567322:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787830221.567328:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316784128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567355:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483ef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316784128:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.567361:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787830221.567373:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787830221.567379:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874675316784640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567407:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483ef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874675316784640:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.567413:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787830221.567429:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787830221.567432:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830221.567434:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830221.567441:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316783616 00000100:00100000:0.0:1787830221.567444:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316783616 00000100:00100000:0.0:1787830221.567470:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830221.567476:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483ef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1874675316783616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567520:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483ef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1874675316783616:12345-0@lo:400:kworker.0 Request processed in 44us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830221.567527:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787830221.567542:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830221.567578:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316783104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787830221.567614:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316783616:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567624:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483cdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316784128:0@lo:400:kworker.0 00010000:00080000:0.0:1787830221.567644:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483cda580 x1874675316784640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830221.567655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483cda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874675316784640:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567664:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316783232:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567672:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316783744:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567681:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874675316784256:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567717:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316783488:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567751:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316784000:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567761:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483cd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874675316784512:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567770:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316783360:0@lo:400:kworker.0 00000100:00100000:0.0:1787830221.567781:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316783872:0@lo:400:kworker.0 00010000:00080000:0.0:1787830221.567792:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483cdad00 x1874675316784384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830221.567802:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874675316784384:0@lo:400:kworker.0 00000100:00100000:1.0:1787830221.568247:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830221.568259:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316784768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830221.568297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830221.568372:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784768 00000100:00100000:3.0:1787830221.568377:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784768 00000100:00100000:3.0:1787830221.568415:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787830221.568423:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874675316784768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787830221.568438:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787830221.568481:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1874675316784768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830221.568488:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787830221.568519:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316784768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787830222.342879:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787830222.592135:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1787830222.592182:0:17074:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f25bb6863c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1787830222.592188:0:17074:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f2582b82a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f25bb686b40 00000020:00080000:3.0:1787830222.592191:0:17074:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f2582b82f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f258728c800 00010000:00010000:1.0:1787830222.592302:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830222.592316:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830222.592324:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830222.592331:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1ba600 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:1.0:1787830222.592336:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830222.592344:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830222.592372:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f248260ed00) 00010000:00010000:1.0:1787830222.592375:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830222.592380:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830222.592387:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc226e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787830222.594814:0:17133:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1787830222.594914:0:17133:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787830222.596442:0:19414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1787830222.596459:0:19414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:0.0:1787830223.016383:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830223.016432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830223.016474:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.016599:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295732864 00000100:00100000:2.0:1787830223.016611:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295732864 00000100:00100000:2.0:1787830223.016675:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:2.0:1787830223.016686:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1d22646-325e-4433-8fc8-4ad790b5c998+13:2393:x1874675295732864:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830223.016800:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1d22646-325e-4433-8fc8-4ad790b5c998+13:2393:x1874675295732864:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 115us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830223.016803:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733120 00000100:00100000:1.0:1787830223.016810:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733120 00000100:00100000:2.0:1787830223.016813:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:1.0:1787830223.016880:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295732992 00000100:00100000:1.0:1787830223.016884:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295732992 00000100:00100000:1.0:1787830223.016909:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:1.0:1787830223.016917:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483ef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:2393:x1874675295733120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830223.016996:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1787830223.017008:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483ef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d0e849-5afb-403c-9ad8-4a7bedf3d526+12:2393:x1874675295732992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830223.022486:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483ef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:2393:x1874675295733120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 5556us (6038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830223.022505:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00080000:1.0:1787830223.022554:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830223.022560:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830223.025882:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483ef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d0e849-5afb-403c-9ad8-4a7bedf3d526+12:2393:x1874675295732992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 8862us (9392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830223.025898:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:2.0:1787830223.038842:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.038893:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.038923:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.038945:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.038967:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.038992:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830223.039023:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733248 00000100:00100000:2.0:1787830223.039032:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733248 00000100:00100000:2.0:1787830223.039087:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733376 00000100:00100000:2.0:1787830223.039091:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733376 00000100:00100000:2.0:1787830223.039120:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733760 00000100:00100000:2.0:1787830223.039122:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733760 00000100:00100000:2.0:1787830223.039134:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733888 00000100:00100000:2.0:1787830223.039137:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733888 00000100:00100000:2.0:1787830223.039171:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1787830223.039182:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24844752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d0e849-5afb-403c-9ad8-4a7bedf3d526+6:2395:x1874675295733376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830223.039258:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24844752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d0e849-5afb-403c-9ad8-4a7bedf3d526+6:2395:x1874675295733376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 77us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830223.039266:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1787830223.039286:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:2.0:1787830223.039294:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2484474b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:2391:x1874675295733248:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:2.0:1787830223.039314:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f26 00000100:00080000:2.0:1787830223.039328:0:18599:0:(import.c:65:import_set_state_nolock()) ffff9f24823f3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787830223.039375:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1787830223.039389:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830223.039502:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2484474b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:93d0e849-5afb-403c-9ad8-4a7bedf3d526+2:2391:x1874675295733248:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 208us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830223.039509:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:2.0:1787830223.039522:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1787830223.039529:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2484475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2391:x1874675295733760:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:2.0:1787830223.039540:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f65 00000100:00080000:2.0:1787830223.039545:0:18599:0:(import.c:65:import_set_state_nolock()) ffff9f25bbc5d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787830223.039576:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787830223.039629:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2484475a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+2:2391:x1874675295733760:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 101us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830223.039636:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1787830223.039648:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1787830223.039662:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2484477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2391:x1874675295733888:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:2.0:1787830223.039674:0:18599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f6c 00000100:00080000:2.0:1787830223.039680:0:18599:0:(import.c:65:import_set_state_nolock()) ffff9f25bbc5c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787830223.039703:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:0.0:1787830223.039716:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830223.039814:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2484477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+2:2391:x1874675295733888:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 150us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830223.039821:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00010000:00010000:2.0:1787830223.039838:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830223.040166:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733504 00000100:00100000:1.0:1787830223.040173:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733504 00000100:00100000:1.0:1787830223.040209:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295733632 00000100:00100000:1.0:1787830223.040212:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295733632 00000100:00100000:1.0:1787830223.040240:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:1.0:1787830223.040248:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24844743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2394:x1874675295733504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830223.040279:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24844743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2394:x1874675295733504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830223.040286:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:1.0:1787830223.040309:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:1.0:1787830223.040315:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2484476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2395:x1874675295733632:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830223.040342:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2484476580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2395:x1874675295733632:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830223.040348:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00080000:1.0:1787830223.040365:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830223.040369:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830223.040371:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830223.040372:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787830223.363955:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830223.516364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830223.516417:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734016 00000100:00100000:0.0:1787830223.516429:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734016 00000100:00100000:0.0:1787830223.516489:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:0.0:1787830223.516502:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d0e849-5afb-403c-9ad8-4a7bedf3d526+12:15585:x1874675295734016:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787830223.516636:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d0e849-5afb-403c-9ad8-4a7bedf3d526+12:15585:x1874675295734016:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 136us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830223.516645:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:3.0:1787830223.520257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830223.520292:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734144 00000100:00100000:3.0:1787830223.520301:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734144 00000100:00100000:3.0:1787830223.520436:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:3.0:1787830223.520447:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:15585:x1874675295734144:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787830223.520611:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:15585:x1874675295734144:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830223.520619:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:3.0:1787830223.530218:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830223.530258:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734400 00000100:00100000:3.0:1787830223.530270:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734400 00000100:00100000:3.0:1787830223.530322:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787830223.530884:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25be3d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d0e849-5afb-403c-9ad8-4a7bedf3d526+12:15585:x1874675295734400:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787830223.532016:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25be3d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:93d0e849-5afb-403c-9ad8-4a7bedf3d526+13:15585:x1874675295734400:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 1677us (1801us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1787830223.532028:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:0.0:1787830223.614084:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316784896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830223.614409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830223.614591:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316784896 00000100:00100000:2.0:1787830223.614601:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316784896 00000100:00100000:2.0:1787830223.614709:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787830223.614884:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316784896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830223.614923:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787830223.615022:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316784896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830223.615031:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787830223.615094:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830223.615162:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316784896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787830224.381162:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830224.639509:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830224.639538:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2484477c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316785024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830224.639615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830224.640207:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785024 00000100:00100000:1.0:1787830224.640218:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785024 00000100:00080000:2.0:1787830224.640293:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830224.640322:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787830224.640335:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316785024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787830224.640363:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787830224.640425:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316785024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830224.640434:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830224.640780:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2484477c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316785024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830225.149427:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316785152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830225.149531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830225.149965:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785152 00000100:00100000:0.0:1787830225.149974:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785152 00000100:00100000:0.0:1787830225.150030:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787830225.150041:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316785152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787830225.150074:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787830225.150157:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316785152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830225.150165:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787830225.150301:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483cdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316785152:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787830225.342360:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787830225.408746:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830225.661752:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830225.669253:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316785280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830225.669407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830225.680286:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785280 00000100:00100000:0.0:1787830225.680306:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785280 00000100:00100000:0.0:1787830225.680396:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787830225.680408:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2484477c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316785280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830225.680463:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830225.680576:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2484477c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316785280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (11170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830225.680583:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787830225.680839:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316785280:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787830226.429539:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830226.685022:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830226.686181:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316785792:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.686291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830226.686358:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830226.686365:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316785664:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.686413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830226.686454:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785664 00000100:00100000:0.0:1787830226.686464:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785664 00000100:00100000:0.0:1787830226.688776:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787830226.688797:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316785664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.688898:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316785664:12345-0@lo:400:kworker.0 Request processed in 110us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830226.688906:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787830226.689003:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316785664:0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.690216:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2587f7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316785536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830226.690291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830226.690334:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316785408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787830226.690361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830226.690394:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830226.690401:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316785920:0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.690427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830226.690514:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785536 00000100:00100000:0.0:1787830226.690898:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785792 00000100:00100000:0.0:1787830226.690905:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785792 00000100:00100000:0.0:1787830226.690957:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787830226.690978:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316785792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.693145:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316785792:12345-0@lo:400:kworker.0 Request processed in 61us (4746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830226.693185:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787830226.693278:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316785792:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.693345:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785920 00000100:00100000:0.0:1787830226.693353:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785920 00000100:00100000:0.0:1787830226.693436:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830226.693447:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316785920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.693549:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316785920:12345-0@lo:400:kworker.0 Request processed in 105us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830226.693556:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830226.693577:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316785408 00000100:00100000:0.0:1787830226.693581:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785408 00000100:00100000:0.0:1787830226.693603:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830226.693609:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316785408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830226.693634:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787830226.693669:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316785408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830226.693675:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830226.693747:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316785920:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.693763:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787830226.693767:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f25bd1ae580, transno 8589934596 00000004:00080000:0.0:1787830226.693778:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787830226.693806:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316785408:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787830226.693959:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787830226.693977:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787830226.695826:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316785536 00000100:00100000:1.0:1787830226.695915:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830226.695927:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316785536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830226.695956:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787830226.696061:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316785536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (5769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830226.696068:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787830226.699370:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830226.699528:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2587f7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316785536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830226.701586:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830226.701750:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316786176:0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.701829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830226.701869:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830226.701875:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316786304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.701901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830226.701940:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786304 00000100:00100000:1.0:1787830226.701948:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786304 00000100:00100000:1.0:1787830226.702027:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830226.702047:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316786304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.702109:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483796940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316786304:12345-0@lo:400:kworker.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830226.702118:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830226.702145:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786176 00000100:00100000:1.0:1787830226.702148:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786176 00000100:00100000:1.0:1787830226.702175:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787830226.702182:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316786176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.702214:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316786176:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830226.702220:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787830226.702285:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316786304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.702296:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316786176:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.703183:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830226.703214:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316786432:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.703263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830226.703883:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786432 00000100:00100000:1.0:1787830226.703892:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786432 00000100:00100000:1.0:1787830226.703954:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830226.703964:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316786432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830226.704020:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316786432:12345-0@lo:400:kworker.0 Request processed in 58us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830226.704028:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787830226.704378:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316786048:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.704423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787830226.704455:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830226.705374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874675316786816:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.705419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830226.705449:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830226.705454:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874675316786688:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.705491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830226.705520:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786048 00000100:00100000:2.0:1787830226.705526:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786048 00000100:00100000:2.0:1787830226.705556:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786816 00000100:00100000:2.0:1787830226.705559:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786816 00000100:00100000:0.0:1787830226.705579:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786688 00000100:00100000:0.0:1787830226.705585:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786688 00000100:00100000:2.0:1787830226.705589:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787830226.705599:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2587f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316786048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.705618:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787830226.705628:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2587f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874675316786816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.705649:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2587f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316786048:12345-0@lo:400:kworker.0 Request processed in 51us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830226.705657:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787830226.705680:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787830226.705680:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2587f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874675316786816:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830226.705693:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787830226.705695:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25be3ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874675316786688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.705746:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874675316786560:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.705754:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25be3ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874675316786688:12345-0@lo:400:kworker.0 Request processed in 65us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830226.705777:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787830226.705779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830226.705816:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316786432:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.705834:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830226.705841:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874675316786944:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.705865:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786560 00000100:00100000:2.0:1787830226.705870:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786560 00000100:00100000:0.0:1787830226.705874:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830226.705895:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316786944 00000100:00100000:2.0:1787830226.705899:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316786944 00000100:00100000:0.0:1787830226.705905:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787830226.705914:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874675316786560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.705942:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787830226.705948:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874675316786560:12345-0@lo:400:kworker.0 Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830226.705954:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874675316786944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.705959:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787830226.705987:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874675316786560:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.706013:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874675316786944:12345-0@lo:400:kworker.0 Request processed in 61us (138us total) trans 0 rc 0/0 00010000:00080000:0.0:1787830226.706020:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2481af1a40 x1874675316786944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830226.706024:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787830226.706044:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787830226.706049:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787830226.706066:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2481af0b40 x1874675316786688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830226.706089:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874675316786688:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.706102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874675316786816:0@lo:400:kworker.0 00000100:00100000:2.0:1787830226.706134:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316786048:0@lo:400:kworker.0 00000100:00100000:0.0:1787830226.706454:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874675316786944:0@lo:400:kworker.0 00010000:00010000:2.0:1787830227.457092:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787830227.924544:0:20469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 07:30:25 (1787830225) 00000100:00100000:0.0:1787830228.140716:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830228.140786:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830228.140811:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830228.140834:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830228.140855:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830228.140890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830228.140921:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734784 00000100:00100000:0.0:1787830228.140930:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734784 00000100:00100000:0.0:1787830228.140995:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295735040 00000100:00100000:0.0:1787830228.140999:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295735040 00000100:00100000:0.0:1787830228.141014:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734656 00000100:00100000:0.0:1787830228.141016:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734656 00000100:00100000:0.0:1787830228.141028:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295735168 00000100:00100000:0.0:1787830228.141030:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295735168 00000100:00100000:0.0:1787830228.141046:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:0.0:1787830228.141066:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483cdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:2392:x1874675295734784:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830228.141143:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483cdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:2392:x1874675295734784:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830228.141152:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:0.0:1787830228.141424:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:0.0:1787830228.141432:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd1ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2392:x1874675295735040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830228.141462:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd1ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2392:x1874675295735040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830228.141469:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:0.0:1787830228.141481:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:0.0:1787830228.141488:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+13:2392:x1874675295734656:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830228.141528:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+13:2392:x1874675295734656:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830228.141536:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:0.0:1787830228.141548:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:0.0:1787830228.141780:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2392:x1874675295735168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830228.141823:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2392:x1874675295735168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 46us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830228.141829:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:0.0:1787830228.141856:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734912 00000100:00100000:0.0:1787830228.141861:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734912 00000100:00100000:0.0:1787830228.142063:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:0.0:1787830228.142071:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+6:2392:x1874675295734912:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830228.142102:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+6:2392:x1874675295734912:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830228.142109:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00080000:0.0:1787830228.142131:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787830228.142135:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830228.142137:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830228.142462:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295734528 00000100:00100000:1.0:1787830228.142467:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295734528 00000100:00100000:1.0:1787830228.142499:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:1.0:1787830228.142506:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1d22646-325e-4433-8fc8-4ad790b5c998+13:2392:x1874675295734528:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830228.142535:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1d22646-325e-4433-8fc8-4ad790b5c998+13:2392:x1874675295734528:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830228.142542:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 172 00010000:00010000:1.0:1787830228.477197:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830228.733643:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316787072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830228.733720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830228.733823:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787072 00000100:00100000:0.0:1787830228.733832:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787072 00000100:00100000:0.0:1787830228.733895:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830228.733905:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316787072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830228.733937:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830228.734007:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316787072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830228.734015:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787830228.734050:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830228.734091:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316787072:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787830228.738994:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:0.0:1787830228.739009:0:17074:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1787830228.739126:0:17133:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1787830228.739138:0:17133:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:3.0:1787830228.741838:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d803d0d-ef6f-43ef-91a9-690a41438d73 00000020:00000080:3.0:1787830228.741851:0:18595:0:(genops.c:885:class_export_put()) final put ffff9f25a9e6b800/6d803d0d-ef6f-43ef-91a9-690a41438d73 00000001:00100000:3.0:1787830228.741873:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000020:00000080:3.0:1787830228.741876:0:18595:0:(genops.c:885:class_export_put()) final put ffff9f24823f1000/93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000020:00000080:0.0:1787830228.741920:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e6b800/6d803d0d-ef6f-43ef-91a9-690a41438d73 for lustre-OST0000 00000020:00000080:0.0:1787830228.741982:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24823f1000/93d0e849-5afb-403c-9ad8-4a7bedf3d526 for lustre-OST0000 00000020:00000080:0.0:1787830228.742001:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25bbc5d000 for lustre-OST0000 00000020:00000080:0.0:1787830228.742006:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24823f3000 for lustre-OST0000 00000001:00100000:0.0:1787830228.743196:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d803d0d-ef6f-43ef-91a9-690a41438d73 00000020:00000080:0.0:1787830228.743204:0:19414:0:(genops.c:885:class_export_put()) final put ffff9f25bbc5a000/6d803d0d-ef6f-43ef-91a9-690a41438d73 00000020:00000080:0.0:1787830228.743556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bbc5a000/6d803d0d-ef6f-43ef-91a9-690a41438d73 for lustre-OST0001 00000020:00000080:0.0:1787830228.743700:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25bbc5c800 for lustre-OST0001 00010000:00010000:2.0:1787830229.500956:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830229.757635:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830229.757659:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25be3c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316787200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830229.757750:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830229.757801:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787200 00000100:00100000:2.0:1787830229.757810:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787200 00000100:00100000:2.0:1787830229.757869:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787830229.757880:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25be3cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316787200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830229.757910:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787830229.757970:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25be3cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316787200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830229.757977:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787830229.758001:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830229.758049:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25be3c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316787200:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787830230.204900:0:17128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787830230.204911:0:17128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787830230.204931:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787830230.204940:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787830230.273993:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830230.274036:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316787328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830230.274112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830230.274807:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787328 00000100:00100000:1.0:1787830230.274816:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787328 00000100:00100000:1.0:1787830230.274890:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787830230.274900:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316787328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830230.274949:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787830230.275026:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316787328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830230.275033:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787830230.275229:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316787328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787830230.532631:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830230.785665:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830230.785706:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316787456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830230.785818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830230.785958:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787456 00000100:00100000:1.0:1787830230.785967:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787456 00000100:00100000:1.0:1787830230.786039:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787830230.786049:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25be3c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316787456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787830230.786086:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787830230.786156:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25be3c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316787456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830230.786163:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787830230.791593:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483795a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316787456:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787830231.550703:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830231.804943:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830231.804968:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25be3ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316787584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830231.804971:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2481af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830231.805194:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316787840:0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.805272:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316788096:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.808461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830231.808554:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316787968:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.808598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830231.809047:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316788480:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.809181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830231.809201:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316788992:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.809222:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830231.809266:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787584 00000100:00100000:2.0:1787830231.809274:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787584 00000100:00100000:2.0:1787830231.809328:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830231.809336:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316787584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830231.809370:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787830231.809425:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316787584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.809433:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787830231.809457:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830231.809472:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787968 00000100:00100000:2.0:1787830231.809477:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787968 00000100:00100000:2.0:1787830231.809495:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788480 00000100:00100000:2.0:1787830231.809497:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788480 00000100:00100000:2.0:1787830231.809509:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787830231.809533:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316787968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.809569:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316787968:12345-0@lo:400:kworker.0 Request processed in 38us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.809575:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787830231.809587:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787830231.809593:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316788480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.809907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830231.809939:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316788352:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.810363:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316788480:12345-0@lo:400:kworker.0 Request processed in 769us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.810372:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787830231.810429:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316787968:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.810440:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316788480:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.810461:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25be3ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316787584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830231.810519:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787840 00000100:00100000:2.0:1787830231.810524:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787840 00000100:00100000:2.0:1787830231.810561:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787830231.810567:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316787840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.810899:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316787840:12345-0@lo:400:kworker.0 Request processed in 331us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.811037:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787830231.811132:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788992 00000100:00100000:2.0:1787830231.811137:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788992 00000100:00100000:2.0:1787830231.811180:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787830231.811188:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316788992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.811231:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316788992:12345-0@lo:400:kworker.0 Request processed in 44us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.811251:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1787830231.811276:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830231.811303:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316788992:0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.811497:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830231.811552:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316788864:0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.811578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830231.811598:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788352 00000100:00100000:2.0:1787830231.811745:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788352 00000100:00100000:2.0:1787830231.811775:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788864 00000100:00100000:2.0:1787830231.811778:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788864 00000100:00100000:2.0:1787830231.812140:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787830231.812152:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316788352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.815116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830231.815183:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316788608:0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.815222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830231.815243:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316789120:0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.815269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830231.815317:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788096 00000100:00100000:1.0:1787830231.815326:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788096 00000100:00100000:1.0:1787830231.815398:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788608 00000100:00100000:1.0:1787830231.815401:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788608 00000100:00100000:1.0:1787830231.815424:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830231.815433:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483794780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316788096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.815546:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830231.815558:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316788608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.815565:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483794780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316788096:12345-0@lo:400:kworker.0 Request processed in 131us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830231.815589:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787830231.815600:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316788608:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830231.815617:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830231.815638:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789120 00000100:00100000:0.0:1787830231.815642:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789120 00000100:00100000:0.0:1787830231.815663:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787830231.815670:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316788864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.815706:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316788864:12345-0@lo:400:kworker.0 Request processed in 36us (4127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830231.815712:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787830231.815743:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787830231.815751:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874675316789120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.815779:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874675316789120:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00080000:1.0:1787830231.815784:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830231.815784:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787830231.815822:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316788864:0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.815830:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874675316789376:0@lo:400:kworker.0 00000100:00100000:0.0:1787830231.815853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830231.815876:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789376 00000100:00100000:0.0:1787830231.815879:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789376 00000100:00080000:1.0:1787830231.817556:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830231.818210:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316788352:12345-0@lo:400:kworker.0 Request processed in 3744us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.818232:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787830231.819415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830231.820118:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316788224:0@lo:400:kworker.0 00000100:00080000:1.0:1787830231.820294:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830231.821130:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787830231.821145:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874675316789376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.821210:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316787712 00000100:00100000:2.0:1787830231.821218:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316787712 00000100:00100000:2.0:1787830231.821266:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830231.821272:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316787712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830231.821291:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787830231.821763:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316788096:0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.821778:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316788608:0@lo:400:kworker.0 00010000:00080000:1.0:1787830231.821792:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bb5f83c0 x1874675316789120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830231.822046:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316789120:0@lo:400:kworker.0 00000100:00080000:1.0:1787830231.822229:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787830231.822292:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316787840:0@lo:400:kworker.0 00000100:00100000:1.0:1787830231.822307:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316788352:0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.824140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830231.824197:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316788736:0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.824231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830231.824255:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874675316789248:0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.824282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830231.824340:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788224 00000100:00100000:3.0:1787830231.824349:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788224 00000100:00100000:3.0:1787830231.825173:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316788736 00000100:00100000:3.0:1787830231.825195:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316788736 00000100:00100000:3.0:1787830231.825225:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830231.825235:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874675316788224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.825311:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874675316788224:12345-0@lo:400:kworker.0 Request processed in 77us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830231.825319:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830231.825335:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830231.825341:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316788736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.825381:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316788736:12345-0@lo:400:kworker.0 Request processed in 40us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830231.825387:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830231.825415:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789248 00000100:00100000:3.0:1787830231.825419:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789248 00000100:00100000:3.0:1787830231.826769:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787830231.826783:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874675316789248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.826850:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874675316789248:12345-0@lo:400:kworker.0 Request processed in 71us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830231.826857:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787830231.826925:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316788224:0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.826941:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316788736:0@lo:400:kworker.0 00000100:00100000:3.0:1787830231.827031:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874675316789248:0@lo:400:kworker.0 00000100:00080000:3.0:1787830231.827065:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830231.828160:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874675316789376:12345-0@lo:400:kworker.0 Request processed in 7016us (12302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830231.828172:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1787830231.828299:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bb5fa580 x1874675316789376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830231.828315:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874675316789376:0@lo:400:kworker.0 00000100:00100000:2.0:1787830231.830803:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316787712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9521us (11636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830231.830817:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787830231.832597:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2481af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316787712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830232.414833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830232.414995:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295735424 00000100:00100000:3.0:1787830232.415005:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295735424 00000100:00100000:3.0:1787830232.415090:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1787830232.415100:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d22646-325e-4433-8fc8-4ad790b5c998+13:2394:x1874675295735424:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830232.415118:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830232.415138:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25ae8b6600/0x8eaa8d1f2dfc1f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827885 expref: 13 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830232.415156:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830232.415221:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1d22646-325e-4433-8fc8-4ad790b5c998+12:2394:x1874675295735424:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 122us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830232.415229:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1787830232.420838:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830232.422351:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830232.422403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830232.422675:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295735808 00000100:00100000:1.0:1787830232.422700:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295735808 00000100:00100000:2.0:1787830232.422785:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295735552 00000100:00100000:2.0:1787830232.422801:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295735552 00000100:00100000:1.0:1787830232.422825:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:1.0:1787830232.422842:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24835a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+6:2391:x1874675295735808:12345-192.168.204.30@tcp:9:umount.0 00000100:00100000:2.0:1787830232.422888:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295735296 00000100:00100000:2.0:1787830232.422906:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295735296 00000020:00000080:1.0:1787830232.422911:0:18598:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f2d 00000020:00010000:1.0:1787830232.422926:0:18598:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f24823f7000: total 0 00000100:00080000:1.0:1787830232.422933:0:18598:0:(import.c:65:import_set_state_nolock()) ffff9f24823f4000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787830232.422946:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787830232.422959:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+13:2393:x1874675295735552:12345-192.168.204.30@tcp:103:ldlm_bl.0 00000001:00000004:1.0:1787830232.423014:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:2.0:1787830232.423027:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830232.423057:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580031e00/0x8eaa8d1f2dfc1f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f482796c expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830232.423076:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830232.423150:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+12:2393:x1874675295735552:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 192us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830232.423159:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787830232.423190:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1787830232.423200:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+11:2392:x1874675295735296:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830232.423211:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830232.423222:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25ae8b6000/0x8eaa8d1f2dfc1f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f48278b6 expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830232.423235:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830232.423251:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24835a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+4:2391:x1874675295735808:12345-192.168.204.30@tcp:9:umount.0 Request processed in 412us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830232.423263:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1787830232.423270:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+10:2392:x1874675295735296:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 69us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830232.423281:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000020:00010000:1.0:1787830232.423348:0:17082:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f24823f7000: total 0 00010000:00010000:1.0:1787830232.423355:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830232.423387:0:17082:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f24823f7000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1787830232.423428:0:17082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787830232.423432:0:17082:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787830215 -> 1787830216 00002000:00010000:1.0:1787830232.423436:0:17082:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787830215 -> 1787830216 00002000:00010000:1.0:1787830232.423438:0:17082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787830232.423471:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a634e9/0x8eaa8d1f2dfc2298 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a4c expref: 3 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830232.423498:0:17082:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f24823f7000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787830232.423510:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830232.423512:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830232.423513:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787830232.424166:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830232.435801:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830232.436003:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295736704 00000100:00100000:1.0:1787830232.436018:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295736704 00000100:00100000:1.0:1787830232.436121:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:1.0:1787830232.436134:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d0e849-5afb-403c-9ad8-4a7bedf3d526+12:2391:x1874675295736704:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:1.0:1787830232.436182:0:17096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f1f 00000020:00010000:1.0:1787830232.436204:0:17096:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f24810d5000: total 0 00000100:00080000:1.0:1787830232.436210:0:17096:0:(import.c:65:import_set_state_nolock()) ffff9f24810d1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787830232.436252:0:17096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:1.0:1787830232.436507:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:93d0e849-5afb-403c-9ad8-4a7bedf3d526+11:2391:x1874675295736704:12345-192.168.204.30@tcp:39:umount.0 Request processed in 374us (723us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1787830232.436516:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00080000:3.0:1787830232.437247:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1787830232.437312:0:17083:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f24810d5000: total 0 00010000:00010000:0.0:1787830232.437406:0:17083:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f24810d5000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1787830232.437461:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f248260ed00) 00010000:00010000:0.0:1787830232.437466:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787830232.437481:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2580031600/0x8eaa8d1f2dfc2244 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a29 expref: 10 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437513:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f25b55efe00) 00010000:00010000:0.0:1787830232.437516:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830232.437521:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1bb200/0x8eaa8d1f2dfc1fff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f482797a expref: 9 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437540:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55ef700) 00010000:00010000:0.0:1787830232.437543:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830232.437547:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc203e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827988 expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437562:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2483464d00) 00010000:00010000:0.0:1787830232.437565:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830232.437569:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1ba000/0x8eaa8d1f2dfc21e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a14 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437582:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2483464d00) 00010000:00010000:0.0:1787830232.437584:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787830232.437588:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc22ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a53 expref: 6 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437605:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f2483464b00) 00010000:00010000:0.0:1787830232.437607:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830232.437623:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25ae8b7c00/0x8eaa8d1f2dfc1fe3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827973 expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437644:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f2483464c00) 00010000:00010000:0.0:1787830232.437660:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787830232.437665:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc20c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f48279b2 expref: 4 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830232.437680:0:17083:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f24810d5000, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1787830232.438018:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830232.438021:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830232.438023:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830232.448496:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830232.448665:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295736832 00000100:00100000:3.0:1787830232.448680:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295736832 00000100:00100000:3.0:1787830232.448809:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1787830232.448822:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+5:2391:x1874675295736832:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:3.0:1787830232.448867:0:17094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f18 00000100:00080000:3.0:1787830232.448903:0:17094:0:(import.c:65:import_set_state_nolock()) ffff9f24823f0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787830232.448943:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787830232.449267:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:93d0e849-5afb-403c-9ad8-4a7bedf3d526+3:2391:x1874675295736832:12345-192.168.204.30@tcp:39:umount.0 Request processed in 446us (786us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787830232.449291:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00080000:0.0:1787830232.449799:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787830232.450045:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830232.576655:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830233.253437:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830233.253509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830233.253551:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830233.253596:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737088 00000100:00100000:3.0:1787830233.253610:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737088 00000100:00100000:0.0:1787830233.253651:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737216 00000100:00100000:0.0:1787830233.253657:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737216 00000100:00100000:0.0:1787830233.253721:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:1.0:1787830233.253765:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295736960 00000100:00100000:1.0:1787830233.253770:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295736960 00000100:00100000:0.0:1787830233.253774:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2393:x1874675295737216:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830233.253806:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:1.0:1787830233.253813:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1d22646-325e-4433-8fc8-4ad790b5c998+10:2393:x1874675295736960:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830233.253890:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2393:x1874675295737216:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 118us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830233.253897:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:1.0:1787830233.259590:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1d22646-325e-4433-8fc8-4ad790b5c998+10:2393:x1874675295736960:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 5754us (6058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830233.259612:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:3.0:1787830233.260491:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:3.0:1787830233.260516:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2393:x1874675295737088:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830233.260719:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2393:x1874675295737088:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 214us (7300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830233.260753:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00080000:3.0:1787830233.260823:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830233.260830:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787830233.598252:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830233.856166:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316789504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830233.856279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830233.856476:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789504 00000100:00100000:1.0:1787830233.856488:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789504 00000100:00100000:1.0:1787830233.856566:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787830233.856595:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316789504:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787830233.856605:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787830233.856642:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787830233.856710:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316789504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830233.856718:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787830233.856931:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316789504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787830234.621430:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830234.882013:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830234.882045:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316789632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830234.882137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830234.884022:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789632 00000100:00100000:1.0:1787830234.884046:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789632 00000100:00100000:1.0:1787830234.884169:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830234.884181:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316789632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787830234.884221:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787830234.884326:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316789632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830234.884334:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787830234.884427:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830234.884511:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316789632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830234.936963:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830234.937004:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830234.937040:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830234.937124:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737472 00000100:00100000:0.0:1787830234.937132:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737344 00000100:00100000:3.0:1787830234.937136:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737472 00000100:00100000:0.0:1787830234.937140:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737344 00000100:00100000:0.0:1787830234.937259:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737600 00000100:00100000:0.0:1787830234.937264:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737600 00000100:00100000:2.0:1787830234.938990:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787830234.939011:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+12:2393:x1874675295737344:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830234.939029:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830234.939050:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25ae8b7400/0x8eaa8d1f2dfc1f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f48278f5 expref: 12 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830234.939070:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830234.939146:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+11:2393:x1874675295737344:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 145us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830234.939154:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787830234.939323:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1787830234.939332:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+10:2395:x1874675295737472:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830234.939342:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830234.939353:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580031000/0x8eaa8d1f2dfc1f88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827965 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830234.939364:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830234.939384:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1d22646-325e-4433-8fc8-4ad790b5c998+9:2395:x1874675295737472:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 54us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830234.939390:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:0.0:1787830234.940084:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1787830234.940097:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d22646-325e-4433-8fc8-4ad790b5c998+8:2393:x1874675295737600:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830234.940106:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830234.940118:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25ae8b6c00/0x8eaa8d1f2dfc1f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827926 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830234.940129:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830234.940162:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1d22646-325e-4433-8fc8-4ad790b5c998+7:2393:x1874675295737600:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 69us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830234.940171:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787830234.952610:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830234.952971:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737856 00000100:00100000:2.0:1787830234.952982:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737856 00000100:00100000:2.0:1787830234.953052:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:2.0:1787830234.953062:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+6:2391:x1874675295737856:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:2.0:1787830234.953121:0:17095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f57 00000020:00010000:2.0:1787830234.953130:0:17095:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f24810d6800: total 0 00000100:00080000:2.0:1787830234.953135:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9f24810d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787830234.953172:0:17095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1787830234.953446:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2391:x1874675295737856:12345-192.168.204.30@tcp:39:umount.0 Request processed in 384us (855us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1787830234.953454:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000020:00010000:1.0:1787830234.954479:0:17082:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f24810d6800: total 0 00010000:00010000:1.0:1787830234.954486:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830234.954544:0:17082:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f24810d6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787830234.954585:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55ef700) 00010000:00010000:1.0:1787830234.954589:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830234.954607:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25ae8b7000/0x8eaa8d1f2dfc204c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f482798f expref: 4 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830234.954631:0:17082:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f24810d6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787830234.954644:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830234.954646:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830234.954647:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830234.983159:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830234.983481:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295737984 00000100:00100000:3.0:1787830234.983492:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295737984 00000100:00100000:3.0:1787830234.983565:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:3.0:1787830234.983576:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d803d0d-ef6f-43ef-91a9-690a41438d73+5:2391:x1874675295737984:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:3.0:1787830234.983624:0:19429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1f5e 00000100:00080000:3.0:1787830234.983637:0:19429:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e6e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787830234.983672:0:19429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:0.0:1787830234.983698:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830234.983982:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d803d0d-ef6f-43ef-91a9-690a41438d73+3:2391:x1874675295737984:12345-192.168.204.30@tcp:39:umount.0 Request processed in 406us (833us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787830234.983991:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1787830235.055186:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830235.055345:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295738240 00000100:00100000:2.0:1787830235.055358:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295738240 00000100:00100000:2.0:1787830235.055433:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:2.0:1787830235.055445:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1d22646-325e-4433-8fc8-4ad790b5c998+7:2391:x1874675295738240:12345-192.168.204.30@tcp:251:umount.0 00000020:00000080:2.0:1787830235.055537:0:17089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1ef5 00000020:00010000:2.0:1787830235.055547:0:17089:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f248233e800: total 0 00000100:00080000:2.0:1787830235.055553:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9f2482338800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787830235.055864:0:17082:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f248233e800: total 0 00010000:00010000:1.0:1787830235.055938:0:17082:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f248233e800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787830235.055983:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1bae00/0x8eaa8d1f2dfc1efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f482787e expref: 3 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830235.056001:0:17082:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f248233e800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787830235.056013:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830235.056016:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830235.056017:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830235.056223:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b1d22646-325e-4433-8fc8-4ad790b5c998+1:2391:x1874675295738240:12345-192.168.204.30@tcp:251:umount.0 Request processed in 779us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830235.056234:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 175 00000020:00000080:2.0:1787830235.056245:0:17089:0:(genops.c:885:class_export_put()) final put ffff9f248233e800/b1d22646-325e-4433-8fc8-4ad790b5c998 00000020:00000080:1.0:1787830235.056434:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248233e800/b1d22646-325e-4433-8fc8-4ad790b5c998 for MGS 00000020:00000080:1.0:1787830235.056483:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2482338800 for MGS 00000100:00100000:3.0:1787830235.389080:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316789760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830235.389183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830235.389372:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789760 00000100:00100000:2.0:1787830235.389381:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789760 00000100:00100000:2.0:1787830235.389451:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787830235.389463:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bbca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316789760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787830235.389720:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787830235.389861:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bbca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316789760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 390us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830235.389871:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787830235.390048:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316789760:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787830235.583993:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830235.644986:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830235.902231:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830235.902254:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316789888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830235.902324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830235.902377:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316789888 00000100:00100000:3.0:1787830235.902384:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316789888 00000100:00100000:3.0:1787830235.902432:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787830235.902451:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316789888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830235.902484:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787830235.902547:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316789888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830235.902555:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787830235.902605:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316789888:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787830236.670325:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830236.925293:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316790016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830236.925368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925410:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316790272:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925423:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316790528:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830236.925460:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.925468:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316790784:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830236.925495:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874675316791552:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.925514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830236.925528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925532:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316791296:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925547:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787830236.925552:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beecc663-5bad-4645-a040-ef27b70418e2:3637:1874675316790144:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.925559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830236.925574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925589:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787830236.925592:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316790656:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.925593:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316790400:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.925611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830236.925611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316790912:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925626:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316791168:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.925644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830236.925644:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925658:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316791424:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925658:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316791680:0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.925675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830236.925690:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790016 00000100:00100000:1.0:1787830236.925696:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790016 00000100:00100000:0.0:1787830236.925698:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790528 00000100:00100000:0.0:1787830236.925700:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790528 00000100:00100000:0.0:1787830236.925761:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791040 00000100:00100000:0.0:1787830236.925765:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791040 00000100:00100000:1.0:1787830236.925987:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830236.925996:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874675316790016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830236.926019:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790400 00000100:00100000:2.0:1787830236.926022:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790400 00002000:00000024:1.0:1787830236.926024:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787830236.926041:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790912 00000100:00100000:2.0:1787830236.926043:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790912 00000100:00100000:2.0:1787830236.926066:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830236.926068:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874675316790016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.926072:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874675316790528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.926075:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830236.926094:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787830236.926101:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316791808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830236.926103:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316790528:12345-0@lo:400:kworker.0 Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.926109:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830236.926121:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787830236.926123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830236.926127:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316790400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.926152:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316790400:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830236.926154:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791808 00000100:00100000:1.0:1787830236.926157:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791808 00000100:00100000:2.0:1787830236.926158:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830236.926169:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787830236.926174:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b60130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316790912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.926176:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787830236.926181:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874675316791808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830236.926189:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787830236.926199:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b60130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316790912:12345-0@lo:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.926205:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787830236.926211:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874675316791808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830236.926217:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830236.926227:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790144 00000100:00100000:2.0:1787830236.926231:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790144 00000100:00100000:2.0:1787830236.926254:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787830236.926260:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25841df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beecc663-5bad-4645-a040-ef27b70418e2+24:3637:x1874675316790144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.926262:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316791808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830236.926287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830236.926288:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25841df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:beecc663-5bad-4645-a040-ef27b70418e2+24:3637:x1874675316790144:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.926293:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787830236.926305:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316790400:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.926315:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316790912:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.926319:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791552 00000100:00100000:2.0:1787830236.926322:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791552 00000100:00100000:1.0:1787830236.926336:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beecc663-5bad-4645-a040-ef27b70418e2:3637:1874675316790144:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.926341:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791296 00000100:00100000:2.0:1787830236.926343:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791296 00000100:00100000:1.0:1787830236.926345:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316790528:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.926353:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790656 00000100:00100000:1.0:1787830236.926356:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316790016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830236.926360:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790656 00000100:00100000:2.0:1787830236.926374:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791168 00000100:00100000:2.0:1787830236.926376:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791168 00000100:00100000:2.0:1787830236.926386:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791680 00000100:00100000:2.0:1787830236.926388:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791680 00000100:00100000:2.0:1787830236.926398:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791424 00000100:00100000:2.0:1787830236.926400:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791424 00000100:00100000:2.0:1787830236.926412:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787830236.926417:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874675316791552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927301:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874675316791552:12345-0@lo:400:kworker.0 Request processed in 878us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927312:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787830236.927335:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787830236.927345:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316791296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927390:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316791296:12345-0@lo:400:kworker.0 Request processed in 49us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927395:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787830236.927407:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787830236.927413:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316790656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927439:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316790656:12345-0@lo:400:kworker.0 Request processed in 27us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830236.927459:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316790656:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927522:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787830236.927536:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787830236.927542:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316791168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927569:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316791168:12345-0@lo:400:kworker.0 Request processed in 28us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927574:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787830236.927600:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787830236.927606:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316791680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927635:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316791680:12345-0@lo:400:kworker.0 Request processed in 30us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927641:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787830236.927652:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787830236.927657:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316791424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927682:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316791424:12345-0@lo:400:kworker.0 Request processed in 26us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927688:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787830236.927709:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790272 00000100:00100000:2.0:1787830236.927714:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790272 00000100:00100000:2.0:1787830236.927752:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316790784 00000100:00100000:2.0:1787830236.927755:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316790784 00000100:00100000:2.0:1787830236.927769:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787830236.927774:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24834c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316790272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927807:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24834c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316790272:12345-0@lo:400:kworker.0 Request processed in 33us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927813:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787830236.927824:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787830236.927830:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316790784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927856:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316790784:12345-0@lo:400:kworker.0 Request processed in 27us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830236.927862:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830236.927908:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874675316791552:0@lo:400:kworker.0 00010000:00080000:2.0:1787830236.927915:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bd298000 x1874675316791424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830236.927934:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316791168:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927936:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316791424:0@lo:400:kworker.0 00010000:00080000:1.0:1787830236.927944:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bd2983c0 x1874675316791680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830236.927947:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316790272:0@lo:400:kworker.0 00000100:00100000:1.0:1787830236.927953:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316791680:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927956:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316790784:0@lo:400:kworker.0 00000100:00100000:2.0:1787830236.927967:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316791296:0@lo:400:kworker.0 00000100:00080000:1.0:1787830236.930321:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830236.930333:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830236.930336:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830236.930339:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830236.931578:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787830236.931593:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316791040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830236.931704:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316791040:12345-0@lo:400:kworker.0 Request processed in 116us (6224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830236.931713:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830236.934616:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316791040:0@lo:400:kworker.0 00000020:01000004:1.0:1787830237.344322:0:20664:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787830237.361773:0:20664:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787830237.362431:0:20664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.362447:0:20664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.362455:0:20664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.362463:0:20664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.362486:0:20664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787830237.362491:0:20664:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787830237.362517:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787830237.362521:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787830237.362526:0:20664:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787830237.362550:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f258928c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787830237.364015:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830237.364032:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.364063:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21fe000 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830237.364068:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.364079:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830237.364087:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830237.364093:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830237.364096:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787830237.364099:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787830237.364140:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.364147:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830237.364173:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.364181:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc1ab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1abf expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.364200:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.364203:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.364205:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830237.364226:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316792064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830237.364302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830237.364383:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874675316791936:0@lo:39:umount.0 00000100:00100000:2.0:1787830237.364416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830237.364457:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316791936 00000100:00100000:2.0:1787830237.364465:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316791936 00000100:00100000:2.0:1787830237.364511:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787830237.364520:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874675316791936:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787830237.364548:0:17095:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1ae9 00000100:00080000:2.0:1787830237.364557:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9f2481a4f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787830237.364613:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1874675316791936:12345-0@lo:39:umount.0 Request processed in 93us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830237.364621:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:2.0:1787830237.364631:0:17095:0:(genops.c:885:class_export_put()) final put ffff9f25bc673800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787830237.364655:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787830237.364664:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc673800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787830237.364713:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2481a4f000 for lustre-MDT0000 00000100:00080000:2.0:1787830237.364774:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f258928c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787830237.364786:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874675316791936:0@lo:39:umount.0 00000100:00080000:2.0:1787830237.364812:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787830237.364815:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787830237.364820:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787830237.366706:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792064 00000100:00100000:0.0:1787830237.366743:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792064 00000100:00100000:0.0:1787830237.367018:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830237.367028:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:beecc663-5bad-4645-a040-ef27b70418e2+24:3640:x1874675316792064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830237.367045:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830237.367068:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc1abf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1ab8 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830237.367649:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830237.368337:0:20664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368352:0:20664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368360:0:20664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368384:0:20664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368408:0:20664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830237.368422:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830237.368428:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368435:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2a00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830237.368438:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368447:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830237.368453:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830237.368458:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830237.368461:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787830237.368494:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368500:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830237.368526:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368533:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b2a00/0x8eaa8d1f2dfc1a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1a10 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368556:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.368558:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.368560:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.368586:0:20664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368593:0:20664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368599:0:20664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368605:0:20664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368617:0:20664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830237.368624:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830237.368628:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368635:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121c400 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830237.368638:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368644:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830237.368650:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830237.368666:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830237.368668:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787830237.368670:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787830237.368686:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368691:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830237.368698:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368704:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f258121c400/0x8eaa8d1f2dfc1e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1e1c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368713:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.368715:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.368716:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.368749:0:20664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368757:0:20664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368763:0:20664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.368769:0:20664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830237.369121:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:beecc663-5bad-4645-a040-ef27b70418e2+23:3640:x1874675316792064:12345-0@lo:103:ldlm_bl.0 Request processed in 2087us (4812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830237.369134:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830237.369216:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beecc663-5bad-4645-a040-ef27b70418e2:3638:1874675316792320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830237.369262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830237.369307:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830237.369313:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beecc663-5bad-4645-a040-ef27b70418e2:3638:1874675316792192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830237.369333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830237.369360:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792320 00000100:00100000:0.0:1787830237.369366:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792320 00000100:00100000:0.0:1787830237.369401:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792192 00000100:00100000:0.0:1787830237.369404:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792192 00000100:00100000:0.0:1787830237.369425:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830237.369434:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beecc663-5bad-4645-a040-ef27b70418e2+24:3638:x1874675316792320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830237.369446:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830237.369463:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f258121ca00/0x8eaa8d1f2dfc1e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1e15 expref: 24 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830237.369477:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830237.369508:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beecc663-5bad-4645-a040-ef27b70418e2+23:3638:x1874675316792320:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830237.369514:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830237.369527:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830237.369533:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beecc663-5bad-4645-a040-ef27b70418e2+22:3638:x1874675316792192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830237.369540:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830237.369559:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d33200/0x8eaa8d1f2dfc1a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1a09 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830237.369582:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830237.369604:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:beecc663-5bad-4645-a040-ef27b70418e2+21:3638:x1874675316792192:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830237.369610:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830237.369650:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beecc663-5bad-4645-a040-ef27b70418e2:3638:1874675316792192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830237.369659:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:beecc663-5bad-4645-a040-ef27b70418e2:3638:1874675316792320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830237.370434:0:20664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787830237.370459:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830237.370467:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370475:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25ae8b6a00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830237.370478:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370487:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830237.370494:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830237.370500:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787830237.370503:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787830237.370506:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787830237.370532:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370539:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830237.370555:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370585:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6a00/0x8eaa8d1f2dfc1fc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1fc7 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370597:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.370599:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.370600:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.370613:0:20664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370629:0:20664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370636:0:20664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370643:0:20664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370664:0:20664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787830237.370668:0:20664:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787830237.370671:0:20664:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787830237.370712:0:20664:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787830237.370716:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787830237.370722:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787830237.370751:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787830237.370757:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f248217c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787830237.370763:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f248217a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787830237.370767:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f25bc687000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787830237.370771:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f24821bf000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787830237.370777:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f24810d6800 6d803d0d-ef6f-43ef-91a9-690a41438d73 192.168.204.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1787830237.370782:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f24810d5000 93d0e849-5afb-403c-9ad8-4a7bedf3d526 192.168.204.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:2.0:1787830237.370796:0:20664:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9f25bb5699b8) has exports, disconnecting them 00000020:00080000:2.0:1787830237.370801:0:20664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f248217c800), last request at 1787830236 00000020:00000080:2.0:1787830237.370807:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1de4 00000100:00080000:2.0:1787830237.370832:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f248217c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787830237.370866:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830237.370883:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.370890:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2400 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830237.371132:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.371140:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830237.371145:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830237.371150:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830237.371153:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787830237.371155:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787830237.371171:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.371177:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787830237.371185:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.371191:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc19fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1a02 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830237.371202:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.371203:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830237.371205:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787830237.371223:0:20664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248217c800): rc 0 00000020:00000080:2.0:1787830237.371226:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f248217c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787830237.371235:0:20664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f248217a800), last request at 1787830236 00000020:00000080:2.0:1787830237.371238:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c86 00000100:00080000:2.0:1787830237.371243:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f2482179800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787830237.371254:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787830237.371260:0:20664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248217a800): rc 0 00000020:00000080:2.0:1787830237.371262:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f248217a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787830237.371266:0:20664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f25bc687000), last request at 1787830153 00000020:00000080:2.0:1787830237.371268:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1bd7 00000100:00080000:2.0:1787830237.371283:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f2583017000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787830237.371357:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787830237.371365:0:20664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f25bc687000): rc 0 00000020:00000080:2.0:1787830237.371367:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25bc687000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787830237.371372:0:20664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f24821bf000), last request at 1787830153 00000020:00000080:2.0:1787830237.371375:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b7c 00000100:00080000:2.0:1787830237.371379:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f24821bb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787830237.371387:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787830237.371393:0:20664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:2.0:1787830237.371465:0:20664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f24821bf000): rc 0 00000004:00000080:2.0:1787830237.371471:0:20664:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbbe50795bae0 00000100:00080000:2.0:1787830237.371490:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787830237.371495:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:0.0:1787830237.371662:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248217c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787830237.371706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248217a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787830237.371737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc687000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787830237.371759:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f248217c000 for lustre-MDT0000 00000020:00000080:0.0:1787830237.371764:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2482179800 for lustre-MDT0000 00000020:00000080:0.0:1787830237.371767:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2583017000 for lustre-MDT0000 00010000:00010000:0.0:1787830237.371789:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830237.372439:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316792448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830237.372523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830237.372591:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830237.372597:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316792576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830237.372619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830237.372653:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792448 00000100:00100000:3.0:1787830237.372661:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792448 00000100:00100000:3.0:1787830237.372720:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792576 00000100:00100000:3.0:1787830237.372748:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792576 00000100:00100000:3.0:1787830237.372783:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830237.372791:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beecc663-5bad-4645-a040-ef27b70418e2+22:3639:x1874675316792448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830237.372805:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830237.372825:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1bac00/0x8eaa8d1f2dfc1fc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1fc0 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830237.372842:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830237.372890:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beecc663-5bad-4645-a040-ef27b70418e2+21:3639:x1874675316792448:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830237.372898:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830237.372939:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787830237.372945:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beecc663-5bad-4645-a040-ef27b70418e2+20:3639:x1874675316792576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830237.372954:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830237.372963:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21ff600/0x8eaa8d1f2dfc1a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc19fb expref: 20 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830237.372973:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830237.372995:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:beecc663-5bad-4645-a040-ef27b70418e2+19:3639:x1874675316792576:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830237.373001:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787830237.373040:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316792576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830237.373049:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316792448:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787830237.374101:0:20664:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787830237.374127:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f2482652000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787830237.375544:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316792704:0@lo:39:umount.0 00000100:00100000:0.0:1787830237.375629:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830237.375743:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792704 00000100:00100000:3.0:1787830237.375751:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792704 00000100:00100000:3.0:1787830237.375801:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787830237.375811:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874675316792704:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787830237.375841:0:17100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c01 00000100:00080000:3.0:1787830237.375851:0:17100:0:(import.c:65:import_set_state_nolock()) ffff9f24821ba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787830237.375886:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787830237.375904:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316792064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830237.376096:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787830237.379047:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787830237.379054:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1787830237.379075:0:20664:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787830237.379159:0:20664:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787830237.379186:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f2482652800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787830237.379953:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316792832:0@lo:9:umount.0 00000100:00100000:0.0:1787830237.380038:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830237.380078:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3636:x1874675316792704:12345-0@lo:39:umount.0 Request processed in 4266us (4445us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787830237.380087:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792832 00000100:00100000:3.0:1787830237.380090:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787830237.380094:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792832 00000100:00100000:1.0:1787830237.380153:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787830237.380163:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874675316792832:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787830237.380204:0:18598:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1ccc 00000100:00080000:1.0:1787830237.380213:0:18598:0:(import.c:65:import_set_state_nolock()) ffff9f258734b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787830237.380269:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1787830237.380296:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787830237.380449:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787830237.380453:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1787830237.380470:0:20664:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787830237.380534:0:20664:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787830237.380550:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e61000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787830237.380607:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f25bb5699b8) has no exports 00000100:00080000:0.0:1787830237.384547:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2482652000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787830237.384576:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316792704:0@lo:39:umount.0 00000100:00100000:0.0:1787830237.384599:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316792960:0@lo:9:umount.0 00000100:00100000:0.0:1787830237.384662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830237.385997:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316792960 00000100:00100000:2.0:1787830237.386011:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316792960 00000100:00100000:2.0:1787830237.386070:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787830237.386080:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874675316792960:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787830237.386120:0:18600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1e23 00000100:00080000:2.0:1787830237.386131:0:18600:0:(import.c:65:import_set_state_nolock()) ffff9f24823f4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787830237.386183:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787830237.386360:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1874675316792960:12345-0@lo:9:umount.0 Request processed in 281us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830237.386367:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1787830237.386399:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830237.386866:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e61000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787830237.386918:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787830237.386921:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787830237.386925:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316792960:0@lo:9:umount.0 00000100:00100000:1.0:1787830237.387482:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3636:x1874675316792832:12345-0@lo:9:umount.0 Request processed in 7317us (7440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830237.387495:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787830237.388661:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2482652800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787830237.388745:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787830237.393467:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787830237.393488:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316792832:0@lo:9:umount.0 00000020:00080000:0.0:1787830237.404098:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f25bb5699b8) has no exports 00000020:00000080:0.0:1787830237.439136:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a56 00000020:00000080:0.0:1787830237.439153:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f2482651800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787830237.439179:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787830237.439325:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2482651800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787830237.439352:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787830237.439363:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787830237.439368:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9f25afbc4d28) has no exports 00000020:00000080:2.0:1787830237.440291:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a4f 00000020:00000080:2.0:1787830237.440301:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e65800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787830237.440377:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830237.440387:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787830237.440390:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e62000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787830237.440392:0:20664:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e62000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787830237.440397:0:20664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787830237.440848:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787830237.693282:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787830237.954146:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830237.954156:0:17074:0:(genops.c:885:class_export_put()) final put ffff9f24821bf000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787830237.954179:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d803d0d-ef6f-43ef-91a9-690a41438d73 00000001:00080000:0.0:1787830237.954187:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:0.0:1787830237.954191:0:17074:0:(genops.c:885:class_export_put()) final put ffff9f24810d6800/6d803d0d-ef6f-43ef-91a9-690a41438d73 00000001:00100000:0.0:1787830237.954196:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000001:00080000:0.0:1787830237.954201:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1787830237.954203:0:17074:0:(genops.c:885:class_export_put()) final put ffff9f24810d5000/93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000020:00000080:2.0:1787830237.954518:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24821bf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787830237.954585:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24810d6800/6d803d0d-ef6f-43ef-91a9-690a41438d73 for lustre-MDT0000 00000001:00100000:1.0:1787830237.955051:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787830237.955055:0:19414:0:(genops.c:885:class_export_put()) final put ffff9f24823f6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787830237.955108:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000020:00000080:1.0:1787830237.955111:0:19414:0:(genops.c:885:class_export_put()) final put ffff9f24823f7000/93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000020:00000080:2.0:1787830237.955174:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24810d5000/93d0e849-5afb-403c-9ad8-4a7bedf3d526 for lustre-MDT0000 00000001:00100000:3.0:1787830237.955866:0:17826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787830237.955878:0:17826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1787830237.955882:0:17826:0:(genops.c:885:class_export_put()) final put ffff9f2583010000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787830237.965169:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24821bb800 for lustre-MDT0000 00000020:00000080:0.0:1787830237.965181:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24810d2800 for lustre-MDT0000 00000020:00000080:0.0:1787830237.965186:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24823f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787830237.965231:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24823f7000/93d0e849-5afb-403c-9ad8-4a7bedf3d526 for lustre-OST0001 00000020:00000080:0.0:1787830237.965247:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24810d1800 for lustre-MDT0000 00000020:00000080:0.0:1787830237.965251:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24823f4800 for lustre-OST0001 00000020:00000080:0.0:1787830237.965254:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24823f4000 for lustre-OST0001 00000001:00100000:3.0:1787830237.965665:0:17826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6d803d0d-ef6f-43ef-91a9-690a41438d73 00000001:00080000:3.0:1787830237.965678:0:17826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1787830237.965682:0:17826:0:(genops.c:885:class_export_put()) final put ffff9f2483629800/6d803d0d-ef6f-43ef-91a9-690a41438d73 00000020:00000080:1.0:1787830237.965707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2583010000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787830237.965773:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24821ba800 for lustre-MDT0001 00000001:00100000:3.0:1787830237.965900:0:17826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000001:00080000:3.0:1787830237.965905:0:17826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1787830237.965908:0:17826:0:(genops.c:885:class_export_put()) final put ffff9f24823f1800/93d0e849-5afb-403c-9ad8-4a7bedf3d526 00000020:00000080:0.0:1787830237.965929:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483629800/6d803d0d-ef6f-43ef-91a9-690a41438d73 for lustre-MDT0001 00000020:00000080:0.0:1787830237.965983:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25a9e6e800 for lustre-MDT0001 00000020:00000080:1.0:1787830237.966090:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24823f1800/93d0e849-5afb-403c-9ad8-4a7bedf3d526 for lustre-MDT0001 00000020:00000080:1.0:1787830237.966238:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24823f0000 for lustre-MDT0001 00010000:00010000:2.0:1787830238.717076:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787830239.486261:0:20664:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f248340b480 - data ffff9f2481c34438/ffff9f24844a0000 00000020:01000000:0.0:1787830239.486417:0:20664:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2483060660 - data ffff9f2598acf6c0/ffff9f25b65c4400 00000001:00000004:0.0:1787830239.504757:0:20664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:3.0:1787830239.560712:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787830239.560723:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787830239.560753:0:20664:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f24836ee580 x1874675316792704/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787830247 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830239.560779:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787830239.566384:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787830239.566393:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787830239.566469:0:20664:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830239.566474:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787830239.569157:0:17118:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787830239.569164:0:17118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787830239.569180:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787830239.575421:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787830239.575430:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1787830239.575445:0:20664:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830239.575448:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787830239.575752:0:17120:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787830239.575757:0:17120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1787830239.575768:0:17120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787830239.585544:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a1e 00000020:00000080:3.0:1787830239.585559:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e4f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787830239.586943:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a33 00000020:00000080:3.0:1787830239.586956:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e4e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787830239.586964:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787830239.586968:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830239.586978:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787830239.586982:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9f25bb56cd28) has no exports 00000020:00000080:0.0:1787830239.587755:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e4f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787830239.587769:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e4e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787830239.588377:0:20664:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787830239.588388:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a95 00000020:00000080:3.0:1787830239.588396:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25896b1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787830239.588428:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787830239.588452:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830239.588461:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787830239.588465:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9f2481b14d28) has no exports 00000020:00000080:3.0:1787830239.588474:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a8e 00000020:00000080:3.0:1787830239.588479:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e67800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787830239.588674:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25896b1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787830239.588683:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e67800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787830239.589613:0:20664:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787830239.589620:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787830239.589624:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1787830239.589632:0:20664:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830239.589634:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787830239.589741:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787830239.589749:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787830239.589755:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a80 00000020:00000080:3.0:1787830239.589762:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25bc674000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787830239.590015:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25a9e61000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787830239.590023:0:14982:0:(genops.c:885:class_export_put()) final put ffff9f25bc675000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787830239.590027:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc675000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787830239.590032:0:14982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787830239.592122:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787830239.592137:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830239.592147:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787830239.592152:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9f25afbc0000) has no exports 00000020:00000080:3.0:1787830239.592160:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a79 00000020:00000080:3.0:1787830239.592168:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e64800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787830239.592302:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc674000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1787830239.592816:0:20664:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787830239.592821:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787830239.592834:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1787830239.592842:0:20664:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830239.592845:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787830239.593191:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e64800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787830239.593288:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787830239.593295:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787830239.593309:0:20664:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787830239.593316:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a6b 00000020:00000080:3.0:1787830239.593322:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e61800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787830239.593345:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2482652800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787830239.593350:0:14982:0:(genops.c:885:class_export_put()) final put ffff9f25a9e65000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787830239.593352:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e65000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787830239.593357:0:14982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787830239.595741:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787830239.595754:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830239.595778:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787830239.595784:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9f2481b119b8) has no exports 00000020:00000080:3.0:1787830239.595794:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a64 00000020:00000080:3.0:1787830239.595802:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f2482654000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787830239.595926:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e61800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787830239.597886:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2482654000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787830239.598901:0:20664:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787830239.598909:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787830239.598913:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787830239.598921:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787830239.598996:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830239.599020:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787830239.599048:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830239.599052:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787830239.599057:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a09e7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787830239.599061:0:20664:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a09e7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787830239.599074:0:20664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787830239.599180:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a3a 00000020:00000080:0.0:1787830239.599189:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e4d800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787830239.599194:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787830239.599198:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830239.599202:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787830239.599207:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9f25bb56b370) has no exports 00000020:00000080:0.0:1787830239.599229:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830239.599233:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787830239.599237:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1a41 00000020:00000080:0.0:1787830239.599240:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e49800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787830239.599249:0:20664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2483e11800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787830239.599252:0:20664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2483e11800 3 00000020:01000004:0.0:1787830239.599255:0:20664:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2483e11800 from lustre-MDT0000 00000020:00000080:0.0:1787830239.599273:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830239.599277:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787830239.599279:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25a9e4c000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787830239.599281:0:20664:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e4c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787830239.599288:0:20664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787830239.599319:0:20664:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787830239.599323:0:20664:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787830239.599326:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787830239.599328:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830239.599331:0:20664:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787830239.599337:0:20664:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9f25880f4000 beecc663-5bad-4645-a040-ef27b70418e2 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787830239.599343:0:20664:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9f25bb568000) has exports, disconnecting them 00000020:00080000:0.0:1787830239.599353:0:20664:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f25880f4000), last request at 1787830137 00000020:00000080:0.0:1787830239.599368:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc19e6 00000020:00010000:0.0:1787830239.599372:0:20664:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f25880f4000: total 2 00000100:00080000:0.0:1787830239.599375:0:20664:0:(import.c:65:import_set_state_nolock()) ffff9f25880f1800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787830239.599390:0:20664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f25880f4000): rc 0 00000020:00080000:0.0:1787830239.599395:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9f25bb568000) has no exports 00000020:00000080:1.0:1787830239.599470:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2482652000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787830239.599479:0:14982:0:(genops.c:885:class_export_put()) final put ffff9f2482651000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787830239.599482:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2482651000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787830239.599490:0:14982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:2.0:1787830239.599524:0:17087:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f25b8a40c00:17087] 0 exiting: rc = 1 00000020:00000080:1.0:1787830239.599563:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e4d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787830239.599568:0:14982:0:(genops.c:885:class_export_put()) final put ffff9f25a9e4e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787830239.599569:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e4e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787830239.599574:0:14982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787830239.599598:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787830239.600339:0:17089:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f25b8a41200:17089] 2 exiting: rc = 0 00000100:00100000:0.0:1787830239.605653:0:17088:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f25b8a41a00:17088] 1 exiting: rc = 0 00000020:00010000:0.0:1787830239.605767:0:17082:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f25880f4000: total 0 00010000:00010000:0.0:1787830239.605772:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830239.605817:0:17082:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f25880f4000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787830239.605866:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580030400/0x8eaa8d1f2dfc1dcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1dc8 expref: 14 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605885:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d32c00/0x8eaa8d1f2dfc19f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc19ed expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605896:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f258121c200/0x8eaa8d1f2dfc1e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1e07 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605911:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d33400/0x8eaa8d1f2dfc1b05 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1afe expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605924:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d33000/0x8eaa8d1f2dfc1c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1c6a expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605935:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21d0e00/0x8eaa8d1f2dfc1f9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1f96 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605945:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc1bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1bbb expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605972:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d32200/0x8eaa8d1f2dfc1b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1b0c expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605984:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580030e00/0x8eaa8d1f2dfc1fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1fa4 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.605994:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f258121c600/0x8eaa8d1f2dfc1b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1b1a expref: 5 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.606003:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc1fb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1fb2 expref: 4 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.606016:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f258121d400/0x8eaa8d1f2dfc1da5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1d9e expref: 3 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.606026:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f258121d800/0x8eaa8d1f2dfc1c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc1c40 expref: 2 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830239.606035:0:17082:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f25880f4000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787830239.606050:0:17082:0:(genops.c:885:class_export_put()) final put ffff9f25880f4000/beecc663-5bad-4645-a040-ef27b70418e2 00010000:00010000:0.0:1787830239.606062:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830239.606064:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830239.606066:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787830239.606147:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25880f4000/beecc663-5bad-4645-a040-ef27b70418e2 for MGS 00000020:00000080:1.0:1787830239.606184:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25880f1800 for MGS 00000100:00100000:1.0:1787830239.606222:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606230:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606236:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606240:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606246:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606252:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606258:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606264:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606270:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606275:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606280:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606285:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606290:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606295:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606300:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606305:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606310:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606315:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606321:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606325:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606331:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606336:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606341:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606346:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606351:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606355:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606360:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606365:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606370:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606378:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606384:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606390:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606397:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606402:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606415:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606420:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606425:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606430:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606436:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606441:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606447:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606453:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606458:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606464:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606469:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606475:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606481:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606487:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606492:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606498:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606504:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606509:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606513:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606520:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606527:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606533:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606539:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606551:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606556:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606561:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606566:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606571:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606576:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830239.606581:0:20664:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787830239.608052:0:20664:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2482117600 - data ffff9f25b08cb948/ffff9f2483437c00 00000020:01000000:1.0:1787830239.608202:0:20664:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f248377cea0 - data ffff9f25b080f0d8/ffff9f24836fbc00 00000020:00000080:1.0:1787830239.609375:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc19ca 00000020:00000080:1.0:1787830239.609386:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f2483dba800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787830239.609415:0:20664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2483e11800 from MGS, refs=2 00000020:01000004:1.0:1787830239.609419:0:20664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2483e11800 2 00000020:01000004:1.0:1787830239.609422:0:20664:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2483e11800 from MGS 00000020:00000080:1.0:1787830239.609443:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787830239.609450:0:20664:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787830239.609453:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f2483dbb000/MGS 00000020:00000080:1.0:1787830239.609455:0:20664:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483dbb000/MGS for MGS 00000020:01000000:1.0:1787830239.609461:0:20664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787830239.609527:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787830239.609531:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787830239.609536:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787830239.609543:0:20664:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f258928e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787830239.609548:0:20664:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9f25865b8000) has exports, disconnecting them 00000020:00080000:1.0:1787830239.609553:0:20664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f258928e000), last request at 1787830137 00000020:00000080:1.0:1787830239.609557:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1acd 00000020:00080000:1.0:1787830239.609569:0:20664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f258928e000): rc 0 00000020:00000080:1.0:1787830239.609574:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f258928e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787830239.610135:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483dba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787830239.610146:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f258928e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787830239.642796:0:20664:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787830239.642807:0:20664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787830239.642813:0:20664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787830239.642821:0:20664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787830239.642874:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f258928c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787830239.643062:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830239.643071:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787830239.643077:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f25b4925000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787830239.643081:0:20664:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25b4925000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787830239.643091:0:20664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787830239.643162:0:20664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2483e11800 1 00000020:00000080:0.0:1787830239.643168:0:20664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc19bc 00000020:00000080:0.0:1787830239.643174:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f2483dba000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787830239.643183:0:20664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787830239.643191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483dba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787830239.643199:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830239.643203:0:20664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787830239.643206:0:20664:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9f2481b10000) has no exports 00010000:00010000:0.0:1787830239.741886:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787830239.760700:0:20664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787830239.760715:0:20664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787830239.760721:0:20664:0:(genops.c:885:class_export_put()) final put ffff9f2483e14000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787830239.760763:0:20664:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483e14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787830239.760775:0:20664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787830239.760912:0:20664:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f2483e10000 00000020:02000400:1.0:1787830239.760999:0:20664:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1787830240.000243:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316793088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830240.000310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830240.000378:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793088 00000100:00100000:0.0:1787830240.000386:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793088 00000100:00100000:0.0:1787830240.000447:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787830240.000457:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316793088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787830240.000486:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830240.000532:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316793088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830240.000539:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787830240.000562:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830240.000597:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316793088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830240.509226:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830240.509251:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316793216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830240.509320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830240.509366:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793216 00000100:00100000:3.0:1787830240.509373:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793216 00000100:00100000:3.0:1787830240.509413:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787830240.509420:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874675316793216:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787830240.509428:0:17099:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787830240.509478:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874675316793216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (157us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787830240.509485:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:02020000:2.0:1787830240.509550:0:3637:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787830240.517062:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787830240.517630:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787830240.517637:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787830240.552820:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830240.552836:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:2.0:1787830240.552848:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f2584dbb800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830240.553890:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b66ff0c0 x1874675316793344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830240.554333:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316793344:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787830240.554402:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830240.554453:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793344 00000100:00100000:2.0:1787830240.554461:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793344 00000100:00100000:2.0:1787830240.554500:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787830240.554508:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316793344:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787830240.554531:0:17099:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787830240.576396:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316793344:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 21877us (21984us total) trans 0 rc -19/-19 00000100:00080000:0.0:1787830240.576396:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830240.576404:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830240.576409:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316793344:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787830240.576412:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1787830240.768326:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830241.789201:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787830242.045774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787830242.045793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787830242.045803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830242.045810:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 629 00000100:00080000:1.0:1787830242.045815:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787830242.045821:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f2584dbb800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787830242.045847:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b6012940 x1874675316793600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787830242.048311:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316793472:0@lo:400:kworker.0 00000400:00000100:1.0:1787830242.048373:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874675316793472 offset 0 length 224: 4 00000100:00100000:1.0:1787830242.048417:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6012d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316794112:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048488:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316794624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830242.048512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048548:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787830242.048556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316793728:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048603:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6012580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316794240:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048661:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6012940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316793600:0@lo:38:kworker.0 00000100:00100000:1.0:1787830242.048688:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048720:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6013840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316793856:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048765:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048794:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6010780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874675316794368:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048833:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787830242.048850:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b60103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316793984:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048890:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b60121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316794496:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.048908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.048934:0:18826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793728 00000100:00100000:1.0:1787830242.048941:0:18826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793728 00000100:00100000:1.0:1787830242.048990:0:18826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793856 00000100:00100000:1.0:1787830242.048993:0:18826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793856 00000100:00100000:1.0:1787830242.049015:0:18826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830242.049023:0:18826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316793728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830242.049477:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794624 00000100:00100000:3.0:1787830242.049484:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794624 00000100:00100000:3.0:1787830242.049524:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787830242.049533:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874675316794624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830242.049564:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787830242.049621:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874675316794624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830242.049628:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830242.052818:0:18826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316793728:12345-0@lo:400:kworker.0 Request processed in 3786us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830242.052835:0:18826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830242.052872:0:18826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830242.052885:0:18826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd299a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316793856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.052934:0:18826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd299a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316793856:12345-0@lo:400:kworker.0 Request processed in 55us (4168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830242.052940:0:18826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787830242.052966:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794112 00000100:00100000:1.0:1787830242.052975:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794112 00000100:00100000:1.0:1787830242.052998:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794240 00000100:00100000:1.0:1787830242.053001:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794240 00000100:00100000:1.0:1787830242.053020:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794368 00000100:00100000:1.0:1787830242.053024:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794368 00000100:00100000:0.0:1787830242.053159:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793984 00000100:00100000:0.0:1787830242.053163:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793984 00000100:00100000:0.0:1787830242.053180:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794496 00000100:00100000:0.0:1787830242.053183:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794496 00000100:00100000:0.0:1787830242.053200:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787830242.053207:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316794240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830242.053247:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316794240:12345-0@lo:400:kworker.0 Request processed in 41us (4620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830242.053253:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787830242.053264:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787830242.053269:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd299e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316794496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830242.053296:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd299e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316794496:12345-0@lo:400:kworker.0 Request processed in 27us (4387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830242.053301:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787830242.053313:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787830242.053317:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b60112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1874675316794112:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787830242.053322:0:17094:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787830242.053347:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b60112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1874675316794112:12345-0@lo:400:kworker.0 Request processed in 29us (4896us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787830242.053351:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787830242.053361:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787830242.053364:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874675316793984:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787830242.053380:0:17094:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787830242.053403:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874675316793984:12345-0@lo:400:kworker.0 Request processed in 37us (4530us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787830242.053408:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787830242.053545:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787830242.053551:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874675316794368:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787830242.053556:0:19429:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787830242.053584:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874675316794368:12345-0@lo:400:kworker.0 Request processed in 32us (4769us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787830242.053599:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787830242.053620:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316793600 00000100:00100000:1.0:1787830242.053624:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316793600 00000100:00100000:1.0:1787830242.053646:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830242.053650:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874675316793600:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787830242.053669:0:17100:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787830242.053707:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874675316793600:12345-0@lo:38:kworker.0 Request processed in 56us (5019us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787830242.053713:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787830242.053891:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830242.053897:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830242.053900:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830242.053955:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830242.053961:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787830242.053965:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6012940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316793600:0@lo:38:kworker.0 00000100:00100000:1.0:1787830242.054011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316793728:0@lo:400:kworker.0 00010000:00080000:1.0:1787830242.054142:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f25b6012580 x1874675316794240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830242.054158:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6012580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316794240:0@lo:400:kworker.0 00000100:00080000:1.0:1787830242.054173:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787830242.054176:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9f25b4925800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787830242.054179:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787830242.054184:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9f25b4925800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830242.054188:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 562 00000100:00080000:1.0:1787830242.054199:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f25b4925800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787830242.054224:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bd298000 x1874675316794752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830242.054277:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874675316794752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787830242.054318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787830242.055102:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787830242.055107:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e69000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787830242.055111:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787830242.055115:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830242.055128:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00100000:1.0:1787830242.055290:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6012d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316794112:0@lo:400:kworker.0 00000100:00100000:1.0:1787830242.055320:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316794624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830242.055360:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794752 00000100:00100000:1.0:1787830242.055366:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794752 00000100:00100000:1.0:1787830242.055401:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830242.055407:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874675316794752:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787830242.055422:0:19429:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787830242.055633:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f25a9e69000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830242.055657:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cc780 x1874675316794880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830242.055824:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874675316794880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787830242.055860:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830242.055967:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874675316794752:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 558us (1647us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787830242.055976:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830242.055995:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316794880 00000100:00100000:1.0:1787830242.055999:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316794880 00000100:00100000:2.0:1787830242.056044:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787830242.056050:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874675316794880:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787830242.056061:0:17095:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787830242.056097:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874675316794880:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 45us (236us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787830242.056113:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787830242.056217:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b60103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316793984:0@lo:400:kworker.0 00010000:00080000:3.0:1787830242.056238:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f25b60121c0 x1874675316794496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830242.056248:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b60121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316794496:0@lo:400:kworker.0 00000100:00100000:3.0:1787830242.056259:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6013840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316793856:0@lo:400:kworker.0 00000100:00080000:3.0:1787830242.056269:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787830242.056273:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787830242.056276:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787830242.056279:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830242.056283:0:3637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1787830242.056287:0:3637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f25b4920000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830242.056303:0:3637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cde00 x1874675316795008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830242.056314:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6010780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874675316794368:0@lo:400:kworker.0 00000100:00080000:0.0:1787830242.059171:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25b4925800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830242.059184:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830242.059189:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874675316794752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787830242.059221:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316795008:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787830242.059280:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787830242.059320:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830242.059325:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830242.059328:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874675316794880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787830242.063374:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795008 00000100:00100000:2.0:1787830242.063391:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795008 00000100:00100000:2.0:1787830242.063447:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787830242.063472:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874675316795008:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787830242.063496:0:17095:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787830242.063584:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874675316795008:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 127us (4303us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787830242.063592:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787830242.063638:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830242.063643:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787830242.063647:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316795008:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1787830242.560754:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787830242.560764:0:18595:0:(genops.c:885:class_export_put()) final put ffff9f258734f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787830242.560807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f258734f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787830242.560859:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f258734b000 for lustre-OST0000 00010000:00010000:0.0:1787830242.820194:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830243.836935:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787830244.035026:0:20868:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787830244.049392:0:20868:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787830244.049454:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.049470:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.049498:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.049506:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.049532:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787830244.049539:0:20868:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787830244.049574:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830244.049580:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787830244.049586:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787830244.049950:0:20868:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e69000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787830244.049958:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830244.049961:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787830244.049965:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787830244.050246:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830244.050257:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830244.050268:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121c000 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830244.050272:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830244.050284:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830244.050301:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830244.050307:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787830244.050311:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787830244.050314:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787830244.050556:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830244.050564:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830244.050601:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830244.050609:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f258121c000/0x8eaa8d1f2dfc1bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1bc2 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830244.050622:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830244.050624:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830244.050627:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830244.050773:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316795136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830244.050853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830244.052036:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795136 00000100:00100000:0.0:1787830244.052048:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795136 00000100:00100000:0.0:1787830244.052093:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830244.052101:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1874675316795136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787830244.052107:0:17079:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787830244 with bad export cookie 10280184264481577446 00010000:00010000:3.0:1787830244.053322:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053335:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053341:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053347:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053375:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830244.053383:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830244.053391:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053406:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053424:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.053427:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2000 already unused, calling callback (ffffffffc125ec20) 00010000:00010000:3.0:1787830244.053436:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053443:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053458:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830244.053464:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053471:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053478:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053483:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053490:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830244.053495:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053502:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053513:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053520:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830244.053528:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787830244.053531:0:20868:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787830244.053561:0:20868:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787830244.053565:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787830244.053569:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830244.053574:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787830244.053581:0:20868:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9f24810d3000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787830244.053587:0:20868:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9f248217d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787830244.053591:0:20868:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9f25b60799b8) has exports, disconnecting them 00000020:00080000:3.0:1787830244.053595:0:20868:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f24810d3000), last request at 1787830242 00000020:00000080:3.0:1787830244.053602:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1df9 00000100:00080000:3.0:1787830244.053619:0:20868:0:(import.c:65:import_set_state_nolock()) ffff9f24810d7000 : changing import state from FULL to CLOSED 10000000:00010000:1.0:1787830244.055272:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055292:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830244.055300:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830244.055306:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787830244.055309:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1787830244.055312:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1787830244.055354:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055361:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830244.055387:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055394:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b2000/0x8eaa8d1f2dfc1b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1b21 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055408:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787830244.055413:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055419:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121c800 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:1.0:1787830244.055422:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787830244.055499:0:20868:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f24810d3000): rc 0 00000020:00000080:3.0:1787830244.055505:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f24810d3000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787830244.055523:0:20868:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f248217d800), last request at 1787830242 00000020:00000080:3.0:1787830244.055535:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c9b 00000100:00080000:3.0:1787830244.055543:0:20868:0:(import.c:65:import_set_state_nolock()) ffff9f248217e800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787830244.055553:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830244.055561:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830244.055566:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787830244.055568:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787830244.055571:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787830244.055588:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055593:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830244.055601:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055607:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f258121c800/0x8eaa8d1f2dfc1e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1e0e expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055621:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830244.055625:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055631:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25ae8b6400 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:1.0:1787830244.055634:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.055640:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830244.056135:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830244.056140:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787830244.056142:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787830244.056145:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787830244.056161:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056167:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830244.056186:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056194:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6400/0x8eaa8d1f2dfc1fb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1fb9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056204:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830244.056208:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056213:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2600 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:1.0:1787830244.056216:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056222:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830244.056228:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830244.056244:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787830244.056246:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787830244.056248:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787830244.056262:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056268:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830244.056274:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056280:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b2600/0x8eaa8d1f2dfc1b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8eaa8d1f2dfc1b13 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830244.056291:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830244.056293:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830244.056295:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830244.057038:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beecc663-5bad-4645-a040-ef27b70418e2:3637:1874675316795264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830244.057128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787830244.057173:0:20868:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248217d800): rc 0 00000020:00000080:3.0:1787830244.057177:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f248217d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787830244.057195:0:20868:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbbe5019c7ae0 00000100:00100000:1.0:1787830244.057197:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830244.057206:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beecc663-5bad-4645-a040-ef27b70418e2:3637:1874675316795392:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787830244.057218:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830244.057235:0:20868:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9f25928cd680 x1874675316793216/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787830256 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830244.057236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830244.057248:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1787830244.057259:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316793216:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1787830244.057326:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24810d3000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787830244.057374:0:14982:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248217d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787830244.057400:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24810d7000 for lustre-MDT0001 00000020:00000080:1.0:1787830244.057404:0:14982:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f248217e800 for lustre-MDT0001 00000100:00100000:1.0:1787830244.057420:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316795520:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787830244.058169:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787830244.058176:0:20868:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbb800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1787830244.060113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830244.060163:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830244.060175:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316795648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830244.060199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830244.060239:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795264 00000100:00100000:1.0:1787830244.060247:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795264 00000100:00100000:1.0:1787830244.060275:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795392 00000100:00100000:1.0:1787830244.060278:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795392 00000100:00100000:1.0:1787830244.060290:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795520 00000100:00100000:1.0:1787830244.060292:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795520 00000100:00100000:1.0:1787830244.060298:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795648 00000100:00100000:1.0:1787830244.060300:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795648 00000100:00100000:1.0:1787830244.060310:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830244.060317:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1874675316795264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787830244.060323:0:17080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787830244 with bad export cookie 10280184264481577446 00000100:00100000:1.0:1787830244.060375:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1874675316795264:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (3247us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787830244.060382:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830244.060398:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787830244.060402:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1874675316795392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787830244.060405:0:17080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787830244 with bad export cookie 10280184264481577446 00000100:00100000:1.0:1787830244.060426:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1874675316795392:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (3192us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787830244.060431:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787830244.060587:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830244.060592:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874675316795520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787830244.060596:0:17080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787830244 with bad export cookie 10280184264481577446 00000100:00100000:1.0:1787830244.060630:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874675316795520:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (522us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787830244.060650:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787830244.060755:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830244.060760:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874675316795648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787830244.060764:0:17080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787830244 with bad export cookie 10280184264481577446 00000100:00100000:1.0:1787830244.060791:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874675316795648:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (591us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787830244.060796:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787830244.060913:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787830244.060918:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9f258557d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787830244.060921:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787830244.061156:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:0.0:1787830244.062828:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830244.062928:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1874675316795136:12345-0@lo:103:ldlm_bl.0 Request processed in 10822us (12070us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787830244.063069:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787830244.066853:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787830244.066863:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787830244.066881:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787830244.066958:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787830244.069574:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787830244.070155:0:20868:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e6d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787830244.070180:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787830244.070185:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787830244.070198:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787830244.070265:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787830244.070279:0:20868:0:(import.c:65:import_set_state_nolock()) ffff9f24837de800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787830244.070317:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f25b60799b8) has no exports 00000100:00100000:3.0:1787830244.073280:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316795776:0@lo:9:umount.0 00000100:00100000:3.0:1787830244.073371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830244.073421:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316795904:0@lo:9:umount.0 00000100:00100000:3.0:1787830244.073445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787830244.082787:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787830244.082793:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787830244.082803:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b6013c00 x1874675316793472/t0(0) o400->MGC192.168.204.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787830258 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830244.082819:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66fed00 x1874675316795136/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787830260 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830244.082828:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd29bc00 x1874675316795264/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787830260 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830244.082838:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd29b840 x1874675316795392/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787830260 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830244.082847:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd299680 x1874675316795520/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787830260 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830244.082855:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd298f00 x1874675316795648/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787830260 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787830244.082862:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787830244.082864:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f258557d000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1787830244.082865:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f258557d000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1787830244.082866:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787830244.082879:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787830244.082884:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9f258557d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830244.082890:0:3639:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 526 00000100:00100000:0.0:1787830244.082895:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:beecc663-5bad-4645-a040-ef27b70418e2:3640:1874675316795136:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787830244.082901:0:3639:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff9f258557d000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787830244.082927:0:18826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795776 00000100:00100000:1.0:1787830244.082936:0:18826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795776 00000100:00100000:1.0:1787830244.083002:0:18826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316795904 00000100:00100000:1.0:1787830244.083006:0:18826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316795904 00000100:00100000:1.0:1787830244.083039:0:18826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830244.083050:0:18826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874675316795776:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787830244.083078:0:18826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1cc5 00000100:00080000:1.0:1787830244.083086:0:18826:0:(import.c:65:import_set_state_nolock()) ffff9f2483209000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787830244.083134:0:18826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1787830244.083193:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830244.083243:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beecc663-5bad-4645-a040-ef27b70418e2:3637:1874675316795264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830244.083263:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:beecc663-5bad-4645-a040-ef27b70418e2:3637:1874675316795392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830244.083334:0:18826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1874675316795776:12345-0@lo:9:umount.0 Request processed in 286us (9962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830244.083341:0:18826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830244.083360:0:18826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830244.083368:0:18826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874675316795904:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787830244.083382:0:18826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1e2a 00000100:00080000:2.0:1787830244.083383:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25a9e6d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787830244.083388:0:18826:0:(import.c:65:import_set_state_nolock()) ffff9f248233b000 : changing import state from FULL to CLOSED 00000004:00080000:2.0:1787830244.083397:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787830244.083400:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787830244.083403:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316795776:0@lo:9:umount.0 00000001:00000004:1.0:1787830244.083421:0:18826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:0.0:1787830244.083443:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830244.083518:0:18826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1874675316795904:12345-0@lo:9:umount.0 Request processed in 151us (10071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830244.083525:0:18826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830244.083583:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bd29b840 x1874675316796032/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787830244.083604:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316795520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830244.083611:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316793472:0@lo:400:kworker.0 00000100:00100000:1.0:1787830244.083633:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:beecc663-5bad-4645-a040-ef27b70418e2:3639:1874675316795648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830244.083770:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beecc663-5bad-4645-a040-ef27b70418e2:3636:1874675316796032:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787830244.083805:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874675316796032 offset 0 length 520: 4 00000100:00080000:2.0:1787830244.083840:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f24837de800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787830244.083865:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787830244.083867:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787830244.083872:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316795904:0@lo:9:umount.0 00000100:00080000:3.0:1787830244.083951:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830244.083956:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1787830244.104772:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f25b60799b8) has no exports 00000020:01000000:2.0:1787830244.174559:0:20868:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2590772780 - data ffff9f25b0aa3510/ffff9f2587409800 00000020:01000000:2.0:1787830244.174755:0:20868:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f25b7d3ea80 - data ffff9f2481c0a870/ffff9f2587126000 00000001:00000004:3.0:1787830244.202271:0:20868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1787830244.257636:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830244.257645:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787830244.257654:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787830244.259413:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787830244.259501:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787830244.259588:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830244.259592:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787830244.260264:0:17835:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787830244.260272:0:17835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1787830244.260282:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787830244.260856:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787830244.260860:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787830244.260873:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830244.260875:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787830244.263252:0:17837:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787830244.263262:0:17837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787830244.263277:0:17837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787830244.264797:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b2f 00000020:00000080:3.0:1787830244.264809:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f2584db9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787830244.265547:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2584db9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787830244.265700:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b44 00000020:00000080:3.0:1787830244.265707:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc686800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787830244.265791:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787830244.265797:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830244.265807:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787830244.265812:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9f2481b13370) has no exports 00000004:01000000:3.0:1787830244.265983:0:20868:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787830244.267095:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b98 00000020:00000080:3.0:1787830244.267105:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc4d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830244.267951:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc686800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787830244.268513:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787830244.268523:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830244.268534:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787830244.268539:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9f25872d0000) has no exports 00000020:00000080:3.0:1787830244.268550:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b91 00000020:00000080:3.0:1787830244.268558:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f24837d8000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787830244.269378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc4d6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787830244.269390:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24837d8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787830244.269603:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787830244.269609:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787830244.269613:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787830244.269620:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830244.269622:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787830244.269674:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787830244.269684:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787830244.269851:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b83 00000020:00000080:3.0:1787830244.269870:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc4d1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787830244.269876:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787830244.269899:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830244.269905:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787830244.269908:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9f25afbc3370) has no exports 00000020:00000080:3.0:1787830244.269916:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b75 00000020:00000080:3.0:1787830244.269920:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc4d3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787830244.270051:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24837de800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787830244.270060:0:37:0:(genops.c:885:class_export_put()) final put ffff9f25bc4d2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830244.270062:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc4d2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787830244.270069:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787830244.270278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc4d1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787830244.270287:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc4d3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787830244.270821:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787830244.270826:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787830244.270829:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787830244.270834:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787830244.270837:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787830244.270874:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787830244.270882:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787830244.270897:0:20868:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787830244.270904:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b67 00000020:00000080:3.0:1787830244.271162:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc4d2800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787830244.271169:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787830244.271174:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830244.271180:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787830244.271183:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9f25afbc19b8) has no exports 00000020:00000080:3.0:1787830244.271191:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b60 00000020:00000080:3.0:1787830244.271196:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25a9e6c000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787830244.271329:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25a9e6d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787830244.271340:0:37:0:(genops.c:885:class_export_put()) final put ffff9f25bc4d7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830244.271343:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc4d7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787830244.271351:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787830244.271435:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc4d2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787830244.271440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e6c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787830244.273330:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787830244.273340:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787830244.273344:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787830244.273352:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787830244.273411:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830244.273531:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787830244.273562:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830244.273566:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787830244.273571:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f2584dbe800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787830244.273575:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2584dbe800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787830244.273587:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787830244.273775:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b4b 00000020:00000080:2.0:1787830244.273782:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc685000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787830244.273789:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787830244.273794:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787830244.273799:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787830244.273802:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f25b607b370) has no exports 00000020:00000080:2.0:1787830244.273841:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830244.273845:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787830244.273849:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1b52 00000020:00000080:2.0:1787830244.273853:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc685800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787830244.273861:0:20868:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f25b4927800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787830244.273864:0:20868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f25b4927800 2 00000020:01000004:2.0:1787830244.273867:0:20868:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f25b4927800 from lustre-MDT0001 00000020:00000080:2.0:1787830244.273884:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830244.273899:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787830244.273902:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f2584dbd000/lustre-MDT0001_UUID 00000020:00000080:2.0:1787830244.273904:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2584dbd000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787830244.273911:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787830244.273942:0:20868:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787830244.273945:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787830244.273948:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787830244.273952:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787830244.273958:0:20868:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f25bc684000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787830244.273964:0:20868:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9f25b607cd28) has exports, disconnecting them 00000020:00080000:2.0:1787830244.273969:0:20868:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f25bc684000), last request at 1787830153 00000020:00000080:2.0:1787830244.273973:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1bd0 00000020:00080000:2.0:1787830244.273985:0:20868:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f25bc684000): rc 0 00000020:00000080:0.0:1787830244.274137:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2584dbb800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787830244.274151:0:37:0:(genops.c:885:class_export_put()) final put ffff9f25a9e68800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830244.274153:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25a9e68800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1787830244.274158:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787830244.274241:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc685000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1787830244.274245:0:37:0:(genops.c:885:class_export_put()) final put ffff9f25bc682000/lustre-MDD0001_UUID 00000020:00000080:0.0:1787830244.274246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc682000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1787830244.274250:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1787830244.274350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc685800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787830244.274708:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc684000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787830244.275096:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc684000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1787830244.288803:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1787830244.288813:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787830244.288817:0:20868:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787830244.288826:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787830244.288854:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25a9e69000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787830244.289088:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830244.289098:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1787830244.289104:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f25bc680000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1787830244.289107:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bc680000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1787830244.289118:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1787830244.289185:0:20868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f25b4927800 1 00000020:00000080:0.0:1787830244.289190:0:20868:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1af7 00000020:00000080:0.0:1787830244.289196:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f24821bc000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1787830244.289205:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1787830244.289213:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24821bc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787830244.289222:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830244.289227:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787830244.289230:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9f25865b99b8) has no exports 00000020:00000080:0.0:1787830244.455341:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830244.455359:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787830244.455450:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f24821b8800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787830244.455456:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24821b8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787830244.455467:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787830244.455599:0:20868:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f25b4922800 00000020:01000000:0.0:1787830244.455624:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787830244.455629:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830244.455633:0:20868:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787830244.455637:0:20868:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9f25865bcd28) has no exports 00000100:00100000:3.0:1787830244.455809:0:17094:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f25bc63ee00:17094] 0 exiting: rc = 1 00000100:00100000:2.0:1787830244.456042:0:17096:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f25bc63e200:17096] 2 exiting: rc = 0 00000100:00100000:2.0:1787830244.456206:0:17095:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f25bc63f400:17095] 1 exiting: rc = 0 00000100:00100000:1.0:1787830244.457255:0:19429:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f24810c9600:19429] 3 exiting: rc = 0 00000100:00100000:2.0:1787830244.457664:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457674:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457680:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457686:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457693:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457699:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457705:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457710:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457717:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457722:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457758:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457764:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.457769:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458136:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458146:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458152:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458166:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458173:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458177:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458183:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458189:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458194:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458199:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458205:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458211:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458217:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458223:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458228:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458234:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458239:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458243:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458248:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458254:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458260:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458266:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458272:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458284:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458290:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458296:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458302:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458308:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458313:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458319:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458325:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458332:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458337:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458343:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458351:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458952:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458960:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458965:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458977:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458984:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458990:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.458995:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459001:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459006:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459011:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459016:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459021:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459027:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459032:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459042:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.459048:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830244.472452:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f25bc63fc00:17097] 0 exiting: rc = 1 00000100:00100000:1.0:1787830244.472716:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f2483c32000:17098] 1 exiting: rc = 0 00000100:00100000:2.0:1787830244.472949:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472961:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472968:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472975:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472981:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472986:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472991:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.472996:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473002:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473008:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473014:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473021:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473028:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473034:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473040:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473045:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473051:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.473057:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474344:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474371:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474378:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474384:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474400:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474405:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474410:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474415:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474419:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474425:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474431:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474437:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474442:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474448:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474454:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474460:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474465:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474470:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474475:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474481:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474486:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474491:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474497:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474502:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474508:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474513:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474519:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474524:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474529:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474534:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474540:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474544:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474551:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474557:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474563:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474568:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474574:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474580:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474586:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474598:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474603:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474608:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474613:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474618:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474622:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.474628:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830244.482488:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f25b884f600:17100] 1 exiting: rc = 0 00000100:00100000:1.0:1787830244.482760:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f2481b01e00:17099] 0 exiting: rc = 1 00000100:00100000:2.0:1787830244.484304:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.484314:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.484321:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.484328:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.484335:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.484342:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.484348:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486514:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486531:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486538:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486545:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486550:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486557:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486582:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486589:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486595:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486601:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486607:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486613:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486621:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486629:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486634:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486638:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486644:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486650:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486673:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486681:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486688:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486709:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486715:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486721:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486764:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486769:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486955:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486963:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486969:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486975:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.486996:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487004:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487010:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487016:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487022:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487027:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487033:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487039:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487045:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487051:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487058:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487136:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487143:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487148:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487154:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487162:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487168:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487189:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487201:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487208:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487215:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487221:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487229:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487235:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487240:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487246:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.487259:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787830244.506123:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f2481b01800:17101] 0 exiting: rc = 1 00000100:00100000:3.0:1787830244.506139:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f2481b00000:17102] 1 exiting: rc = 0 00000100:00100000:2.0:1787830244.506234:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506243:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506247:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506252:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506258:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506263:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506268:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506276:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506283:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506291:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506298:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506308:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506313:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506317:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506322:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506327:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506332:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506337:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506343:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506348:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506353:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506359:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506363:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506368:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506373:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506377:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506382:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506387:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506392:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506397:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506402:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506406:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506411:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506415:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506432:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506438:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506443:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506448:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506454:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506458:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506464:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506468:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506473:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506478:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506482:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506487:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506491:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506497:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506503:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506509:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506514:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506519:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506524:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506530:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506535:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506541:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506547:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506553:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.506558:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507140:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507150:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507156:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507162:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507170:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507555:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f2481b01400:17103] 0 exiting: rc = 1 00000100:00100000:2.0:1787830244.507875:0:17104:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f25bc63f600:17104] 1 exiting: rc = 0 00000100:00100000:2.0:1787830244.507931:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507937:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.507943:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508108:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508114:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508119:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508125:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508131:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508135:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508140:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508145:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508150:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508155:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508160:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508165:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508171:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508176:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508181:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508186:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508190:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508196:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508200:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508206:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508211:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508216:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508222:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508228:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508233:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508239:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508244:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508251:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508257:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508262:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508268:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508273:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508278:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508283:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508287:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508300:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508304:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508308:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508314:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508319:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508324:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508329:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508335:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508340:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508346:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508350:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508357:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508364:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508369:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508374:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508378:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508641:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508647:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508653:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508658:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508663:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508668:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508673:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508678:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508683:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.508688:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509094:0:17105:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f25b8a41000:17105] 0 exiting: rc = 1 00000100:00100000:0.0:1787830244.509266:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f259282a600:17106] 1 exiting: rc = 0 00000100:00100000:2.0:1787830244.509364:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509372:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509379:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509385:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509390:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509396:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509402:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509408:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509424:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509430:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509436:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509441:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509446:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509451:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509456:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509462:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509468:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509472:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509477:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509482:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509487:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509492:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509497:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509502:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509508:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509514:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509519:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509524:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509530:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509535:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509540:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509545:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509551:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509557:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509563:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509568:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509573:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509578:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509583:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509588:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509593:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509598:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509603:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509616:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509621:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509627:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509632:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509637:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509642:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509648:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509653:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509658:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509663:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509669:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509674:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509679:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509684:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509688:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509692:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509697:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509702:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509706:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509712:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.509717:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.512942:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f25bb679400:17109] 2 exiting: rc = 0 00000100:00100000:0.0:1787830244.513259:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f25bb678600:17107] 0 exiting: rc = 1 00000100:00100000:0.0:1787830244.513475:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f25bb678200:17108] 1 exiting: rc = 0 00000100:00100000:2.0:1787830244.513686:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513694:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513701:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513707:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513712:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513717:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513815:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513823:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513829:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513836:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513842:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513847:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513853:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513873:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513894:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513901:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513908:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513914:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513920:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513928:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513934:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513940:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513946:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513952:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513958:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513965:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513971:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513977:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513985:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.513993:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514001:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514007:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514014:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514020:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514026:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514032:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514038:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514047:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514072:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514080:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514086:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514092:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514098:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514104:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514110:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514116:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514123:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514130:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514144:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514151:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514156:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514163:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514168:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514174:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514179:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514185:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514190:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514195:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514200:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514206:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514211:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514217:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514223:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830244.514229:0:20868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787830244.521288:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830244.521305:0:20868:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787830244.521312:0:20868:0:(genops.c:885:class_export_put()) final put ffff9f258557c000/MDS_uuid 00000020:00000080:2.0:1787830244.521318:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffff9f258557c000/MDS_uuid for MDS 00000020:01000000:2.0:1787830244.521325:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787830244.521489:0:20868:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787830244.860956:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830245.885223:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830246.913126:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830247.166832:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830247.166841:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830247.166844:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830247.166848:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787830247.166852:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25b4925800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830247.166860:0:14982:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 631 00000100:00080000:0.0:1787830247.166865:0:14982:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787830247.166872:0:14982:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f25b4925800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830247.166907:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b66fe580 x1874675316796160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830247.166956:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830247.166959:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787830247.166970:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830247.166974:0:14982:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 631 00000100:00080000:0.0:1787830247.166976:0:14982:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787830247.166981:0:14982:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f25b4920000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830247.166994:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b66fe1c0 x1874675316796416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830247.167217:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874675316796544:0@lo:400:kworker.0 00000400:00000100:0.0:1787830247.167271:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796544 offset 0 length 224: 4 00000100:00100000:0.0:1787830247.167304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830247.167309:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316796288:0@lo:400:kworker.0 00000400:00000100:0.0:1787830247.167323:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796288 offset 0 length 224: 4 00000100:00100000:2.0:1787830247.168368:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874675316796160:0@lo:38:kworker.0 00000400:00000100:2.0:1787830247.168414:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796160 offset 0 length 520: 4 00000100:00100000:2.0:1787830247.168438:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316796416:0@lo:38:kworker.0 00000400:00000100:2.0:1787830247.168456:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796416 offset 0 length 520: 4 00010000:00010000:0.0:1787830247.933863:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787830248.525989:0:21070:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787830248.613357:0:21070:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787830248.613414:0:21070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830248.613431:0:21070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830248.613450:0:21070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830248.613458:0:21070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830248.613473:0:21070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787830248.613478:0:21070:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787830248.613502:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830248.613513:0:21070:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66fe580 x1874675316796160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787830262 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830248.613531:0:21070:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787830248.613536:0:21070:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787830248.613542:0:21070:0:(import.c:65:import_set_state_nolock()) ffff9f25b4925800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787830248.613547:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830248.613550:0:21070:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66fe580 x1874675316796160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787830262 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830248.613557:0:21070:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787830248.613560:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1787830248.613600:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874675316796160:0@lo:38:kworker.0 00000100:00080000:3.0:1787830248.614599:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787830248.614608:0:21070:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66fc780 x1874675316796288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830263 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830248.614624:0:21070:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787830248.614627:0:21070:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787830248.614646:0:21070:0:(import.c:65:import_set_state_nolock()) ffff9f2483208800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787830248.614701:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316796288:0@lo:400:kworker.0 00000100:00100000:3.0:1787830248.614749:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874675316796672:0@lo:39:umount.0 00000400:00000100:3.0:1787830248.614799:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796672 offset 0 length 224: 4 00010000:00010000:2.0:1787830248.615785:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830248.615797:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830248.615808:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121de00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830248.615812:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830248.615833:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830248.615842:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830248.615847:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830248.615849:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787830248.615853:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787830248.615872:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:2.0:1787830248.615876:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830248.615882:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f258121de00/0x8eaa8d1f2dfc1c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1c71 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830248.615895:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830248.615897:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830248.615911:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830248.956977:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830249.214152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830249.214163:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830249.214166:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830249.214170:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787830249.214273:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316796800:0@lo:400:kworker.0 00000400:00000100:1.0:1787830249.214332:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796800 offset 0 length 224: 4 00000001:00100000:3.0:1787830249.735278:0:18595:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787830249.735300:0:18595:0:(genops.c:885:class_export_put()) final put ffff9f2483208000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830249.735403:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483208000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787830249.735447:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2483209000 for lustre-OST0000 00000001:00100000:0.0:1787830249.735757:0:19414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787830249.735761:0:19414:0:(genops.c:885:class_export_put()) final put ffff9f2482339000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787830249.735809:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2482339000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787830249.735839:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f248233b000 for lustre-OST0001 00010000:00010000:2.0:1787830249.981445:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830251.006813:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830252.036295:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787830252.221692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787830252.221703:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830252.221707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787830252.221710:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787830252.221866:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787830252.224919:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316796928:0@lo:400:kworker.0 00000400:00000100:1.0:1787830252.224995:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316796928 offset 0 length 224: 4 00010000:00010000:0.0:1787830253.053624:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830254.076997:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830254.780879:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830244/real 1787830244] req@ffff9f25bd29b840 x1874675316796032/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787830254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830254.780930:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25bd29b840 x1874675316796032/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787830254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787830254.780951:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f258557d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830254.780984:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787830254.780988:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beecc663-5bad-4645-a040-ef27b70418e2:3636:1874675316796032:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787830254.781192:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787830254.781204:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787830254.781207:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f258557d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830254.781213:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 633 00000100:00080000:2.0:1787830254.781218:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787830254.781224:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff9f258557d000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830254.781253:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ecf00 x1874675316797056/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830254.781281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787830254.781285:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787830254.781317:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beecc663-5bad-4645-a040-ef27b70418e2:3636:1874675316797056:0@lo:250:kworker.0 00000400:00000100:0.0:1787830254.781367:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874675316797056 offset 0 length 520: 4 00000100:00100000:3.0:1787830254.781405:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316797184:0@lo:400:kworker.0 00000400:00000100:3.0:1787830254.781436:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316797184 offset 0 length 224: 4 00010000:00010000:0.0:1787830255.101095:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830256.124932:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830257.149181:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830258.172903:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830258.879380:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830248/real 1787830248] req@ffff9f25928cc3c0 x1874675316796672/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787830258 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830258.879419:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25928cc3c0 x1874675316796672/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787830258 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787830258.879441:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2483208800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787830258.879470:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874675316796672:0@lo:39:umount.0 00000100:00080000:3.0:1787830258.879761:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787830258.879766:0:21070:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787830258.879771:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787830258.880706:0:21070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880760:0:21070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880769:0:21070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880776:0:21070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880805:0:21070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830258.880811:0:21070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880818:0:21070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880838:0:21070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880844:0:21070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830258.880865:0:21070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787830258.880870:0:21070:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787830258.880894:0:21070:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787830258.880898:0:21070:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787830258.880903:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830258.880908:0:21070:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787830258.880912:0:21070:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9f25872d3370) has no exports 00000020:00080000:3.0:1787830258.880935:0:21070:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9f25872d3370) has no exports 00010000:00010000:2.0:1787830258.881514:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830258.881524:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881534:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d1e00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830258.881538:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881548:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830258.881555:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830258.881560:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830258.881563:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787830258.881565:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787830258.881594:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:2.0:1787830258.881598:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881605:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc1c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1c47 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881620:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830258.881623:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881628:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25ae8b6800 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830258.881631:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881636:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830258.881641:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830258.881646:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787830258.881648:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787830258.881649:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787830258.881653:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:2.0:1787830258.881656:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881662:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6800/0x8eaa8d1f2dfc1fa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1fab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830258.881680:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830258.881683:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830258.881685:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830258.882992:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787830258.886422:0:21070:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2590772cc0 - data ffff9f25b09a6ca8/ffff9f2587409c00 00000020:01000000:3.0:1787830258.886580:0:21070:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2482203600 - data ffff9f25b0a76510/ffff9f2587356c00 00100000:10000000:3.0:1787830258.902867:0:21070:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787830258.927385:0:21070:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c55 00000020:00000080:0.0:1787830258.927401:0:21070:0:(genops.c:885:class_export_put()) final put ffff9f248362d800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787830258.927429:0:21070:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f25bfb3c000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787830258.927433:0:21070:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f25bfb3c000 2 00000020:01000004:0.0:1787830258.927436:0:21070:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f25bfb3c000 from lustre-OST0000 00000020:00000080:0.0:1787830258.927475:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830258.927486:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787830258.927489:0:21070:0:(genops.c:885:class_export_put()) final put ffff9f248362e000/lustre-OST0000_UUID 00000020:00000080:0.0:1787830258.927503:0:21070:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248362e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787830258.927510:0:21070:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787830258.927585:0:21070:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787830258.927591:0:21070:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787830258.927596:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830258.927602:0:21070:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787830258.927609:0:21070:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f248320a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787830258.927616:0:21070:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9f24823199b8) has exports, disconnecting them 00000020:00080000:0.0:1787830258.927622:0:21070:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f248320a000), last request at 1787830172 00000020:00000080:0.0:1787830258.927626:0:21070:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c7f 00000020:00080000:0.0:1787830258.927636:0:21070:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248320a000): rc 0 00000020:00000080:0.0:1787830258.927642:0:21070:0:(genops.c:885:class_export_put()) final put ffff9f248320a000/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787830258.928414:0:21070:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787830258.928421:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787830258.928425:0:21070:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787830258.928432:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787830258.928596:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787830258.928603:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787830258.928609:0:21070:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787830258.928613:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787830258.928617:0:21070:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787830258.928622:0:21070:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f248320b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787830258.928629:0:21070:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9f248231b370) has exports, disconnecting them 00000020:00080000:1.0:1787830258.928633:0:21070:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f248320b800), last request at 1787830173 00000020:00000080:1.0:1787830258.928636:0:21070:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c94 00000020:00080000:1.0:1787830258.928649:0:21070:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248320b800): rc 0 00000020:00000080:1.0:1787830258.928663:0:21070:0:(genops.c:885:class_export_put()) final put ffff9f248320b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787830258.929338:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248362d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787830258.929349:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248320a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787830258.929354:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25b4925800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787830258.929360:0:37:0:(genops.c:885:class_export_put()) final put ffff9f25bfb3c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787830258.929362:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bfb3c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787830258.929366:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787830258.929428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248320b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787830258.965755:0:21070:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787830258.965766:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787830258.965771:0:21070:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787830258.965780:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787830258.966028:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787830258.966037:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787830258.966044:0:21070:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f25bfb3c000 1 00000020:00000080:1.0:1787830258.966051:0:21070:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1c32 00000020:00000080:1.0:1787830258.966061:0:21070:0:(genops.c:885:class_export_put()) final put ffff9f248367b000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787830258.966067:0:21070:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787830258.966074:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787830258.966078:0:21070:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787830258.966082:0:21070:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9f25872d19b8) has no exports 00000020:00000080:3.0:1787830258.966388:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2483208800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787830258.966396:0:37:0:(genops.c:885:class_export_put()) final put ffff9f248320c800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787830258.966400:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248320c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787830258.966427:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787830258.966504:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248367b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787830259.028567:0:21070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787830259.028583:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787830259.028588:0:21070:0:(genops.c:885:class_export_put()) final put ffff9f25bfb3a000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787830259.030431:0:21070:0:(genops.c:844:class_export_destroy()) destroying export ffff9f25bfb3a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787830259.030461:0:21070:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787830259.030615:0:21070:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f25bfb3d800 00000020:02000400:3.0:1787830259.030667:0:21070:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787830259.197252:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830259.966208:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830259.966223:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830259.966226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787830259.966230:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830259.966446:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830259.975321:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316797312:0@lo:400:kworker.0 00000400:00000100:0.0:1787830259.975424:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316797312 offset 0 length 224: 4 00010000:00010000:0.0:1787830260.223196:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830261.250049:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830262.274438:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830262.974008:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830247/real 1787830247] req@ffff9f25b66fe1c0 x1874675316796416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787830262 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830262.974121:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25b66fe1c0 x1874675316796416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787830262 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787830262.974152:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830262.974240:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787830262.974258:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316796416:0@lo:38:kworker.0 00000100:00080000:1.0:1787830262.977514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787830262.977528:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830262.977531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787830262.977536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787830262.977543:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830262.977554:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1787830262.977563:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787830262.977574:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f25b4920000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787830262.978278:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bd2983c0 x1874675316797440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830262.978422:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316797440:0@lo:38:kworker.0 00000400:00000100:3.0:1787830262.978501:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316797440 offset 0 length 520: 4 00000100:00100000:0.0:1787830262.979170:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316797568:0@lo:400:kworker.0 00000400:00000100:0.0:1787830262.979211:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316797568 offset 0 length 224: 4 00010000:00010000:3.0:1787830263.293966:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787830263.357089:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830247/real 1787830247] req@ffff9f25b66fd2c0 x1874675316796544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787830263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830263.388515:0:3638:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9f25b66fd2c0 x1874675316796544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787830263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787830263.388539:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9f24823f5000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787830263.388546:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787830263.412895:0:3638:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787830263.412933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787830263.412940:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) beecc663-5bad-4645-a040-ef27b70418e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830263.412944:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787830263.412948:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787830263.412953:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f24823f5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830263.412966:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1787830263.413002:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f24823f5000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830263.413054:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cf840 x1874675316797696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830263.413108:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874675316797696:0@lo:38:kworker.0 00000400:00000100:3.0:1787830263.413177:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874675316797696 offset 0 length 520: 4 00000100:00100000:3.0:1787830263.413261:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874675316796544:0@lo:400:kworker.0 00000020:01000004:2.0:1787830263.741244:0:21274:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787830263.750469:0:21274:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787830263.750596:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.750615:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.750623:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.750629:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.750708:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787830263.750715:0:21274:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787830263.750775:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830263.750791:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd2983c0 x1874675316797440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787830282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830263.750809:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787830263.750853:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787830263.750858:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1787830263.751403:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316797440:0@lo:38:kworker.0 00000100:00080000:3.0:1787830263.751450:0:21274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787830263.751457:0:21274:0:(import.c:65:import_set_state_nolock()) ffff9f25b4920000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787830263.751464:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787830263.751466:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787830263.751471:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787830263.755840:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787830263.755867:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66ff480 x1874675316796800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830265 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.755935:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24836ec780 x1874675316796928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.755944:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24836ecb40 x1874675316797184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.755959:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66fcf00 x1874675316797312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830275 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.755968:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd298000 x1874675316797568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.755977:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25928cf840 x1874675316797696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787830273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.755990:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787830263.755997:0:21274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787830263.756006:0:21274:0:(import.c:65:import_set_state_nolock()) ffff9f24823f5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787830263.756012:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787830263.756016:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66ff480 x1874675316796800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830265 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.756024:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24836ec780 x1874675316796928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830268 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.756032:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24836ecb40 x1874675316797184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830270 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.756158:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25b66fcf00 x1874675316797312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830275 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.756169:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25bd298000 x1874675316797568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.756177:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f25928cf840 x1874675316797696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787830273 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830263.756191:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787830263.756195:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787830263.762616:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316797568:0@lo:400:kworker.0 00000100:00100000:3.0:1787830263.762654:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316796928:0@lo:400:kworker.0 00000100:00100000:3.0:1787830263.762664:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316796800:0@lo:400:kworker.0 00000100:00100000:3.0:1787830263.762721:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316797312:0@lo:400:kworker.0 00000100:00100000:3.0:1787830263.762753:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316797184:0@lo:400:kworker.0 00000100:00100000:3.0:1787830263.762790:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874675316797696:0@lo:38:kworker.0 00010000:00010000:2.0:1787830263.763091:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830263.763106:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830263.763119:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25ae8b6e00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830263.763124:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830263.763137:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830263.763147:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830263.763179:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787830263.763182:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787830263.763185:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787830263.763209:0:17082:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:2.0:1787830263.763213:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830263.763221:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6e00/0x8eaa8d1f2dfc1dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1dcf expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.763579:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830263.763584:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830263.763586:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830263.766563:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766591:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766599:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766607:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766638:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830263.766647:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766654:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766660:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766666:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.766716:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787830263.766750:0:21274:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787830263.766789:0:21274:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787830263.766795:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787830263.766800:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787830263.766808:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787830263.766813:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9f25bc77cd28) has no exports 00000020:00080000:1.0:1787830263.766850:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9f25bc77cd28) has no exports 00010000:00010000:3.0:1787830263.767028:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830263.767048:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767057:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b3400 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:3.0:1787830263.767062:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767072:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830263.767081:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830263.767102:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787830263.767106:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787830263.767109:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787830263.767128:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:3.0:1787830263.767132:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767140:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b3400/0x8eaa8d1f2dfc1d9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1da5 expref: -99 pid: 19413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767155:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830263.767159:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767165:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25ae8b6200 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:3.0:1787830263.767168:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767175:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787830263.767181:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830263.767186:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787830263.767188:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787830263.767190:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787830263.767194:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:3.0:1787830263.767197:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767210:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25ae8b6200/0x8eaa8d1f2dfc1f96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1f9d expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830263.767225:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830263.767226:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830263.767228:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830263.767434:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787830263.771414:0:21274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f25907724e0 - data ffff9f25b0a58870/ffff9f258735d000 00000020:01000000:1.0:1787830263.772657:0:21274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2590772180 - data ffff9f25b08946c0/ffff9f2587409400 00100000:10000000:2.0:1787830263.800417:0:21274:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787830263.822552:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1db3 00000020:00000080:1.0:1787830263.822576:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f248217d000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787830263.822603:0:21274:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f248362d000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787830263.822607:0:21274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f248362d000 2 00000020:01000004:1.0:1787830263.822611:0:21274:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f248362d000 from lustre-OST0001 00000020:00000080:2.0:1787830263.822637:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248217d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787830263.822642:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787830263.822657:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787830263.822661:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f248217e000/lustre-OST0001_UUID 00000020:00000080:1.0:1787830263.823347:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248217e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787830263.823368:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787830263.823524:0:21274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import beecc663-5bad-4645-a040-ef27b70418e2->MGS 00010000:00010000:1.0:1787830263.823548:0:21274:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b3000/0x8eaa8d1f2dfc1afe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc1b05 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830263.823564:0:21274:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b3000/0x8eaa8d1f2dfc1afe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc1b05 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830263.823571:0:21274:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787830263.823575:0:21274:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787830263.823591:0:21274:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787830263.823611:0:21274:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:1.0:1787830263.823616:0:21274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b3000/0x8eaa8d1f2dfc1afe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc1b05 expref: -99 pid: 17825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830263.823635:0:21274:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25814b2800/0x8eaa8d1f2dfc19ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8eaa8d1f2dfc19f4 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830263.823642:0:21274:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25814b2800/0x8eaa8d1f2dfc19ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8eaa8d1f2dfc19f4 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830263.823648:0:21274:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787830263.823651:0:21274:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787830263.823653:0:21274:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787830263.823663:0:21274:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f258557d000 00010000:00010000:1.0:1787830263.826590:0:21274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25814b2800/0x8eaa8d1f2dfc19ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8eaa8d1f2dfc19f4 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787830263.826643:0:21274:0:(import.c:65:import_set_state_nolock()) ffff9f258557d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787830263.826649:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787830263.826653:0:21274:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787830263.826654:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787830263.826661:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787830263.827292:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f24836ecf00 x1874675316797056/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787830269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787830263.827327:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787830263.827331:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1787830263.827988:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:beecc663-5bad-4645-a040-ef27b70418e2:3636:1874675316797056:0@lo:250:kworker.0 10000000:01000000:1.0:1787830263.828216:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787830263.828233:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc19d8 00000020:00000080:1.0:1787830263.828244:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f258557e000/beecc663-5bad-4645-a040-ef27b70418e2 00000020:01000000:1.0:1787830263.828273:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.130@tcp (flags='') 00000020:00000080:1.0:1787830263.828286:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787830263.828314:0:21274:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787830263.828321:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9f25865bb370) has no exports 00000020:00000080:3.0:1787830263.828330:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f258557e000/beecc663-5bad-4645-a040-ef27b70418e2 for MGC192.168.204.130@tcp 10000000:01000000:0.0:1787830263.828757:0:17091:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787830263.828807:0:21274:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.130@tcp: client import never connected 00000100:00080000:1.0:1787830263.828812:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787830263.828815:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787830263.828819:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787830263.828822:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787830263.828856:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f258557d000 for MGC192.168.204.130@tcp 00000020:00000080:1.0:1787830263.828882:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787830263.828891:0:21274:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.130@tcp (uuid beecc663-5bad-4645-a040-ef27b70418e2) 00000020:00000080:1.0:1787830263.828895:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f258557a800/beecc663-5bad-4645-a040-ef27b70418e2 00000020:00000080:1.0:1787830263.828898:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff9f258557a800/beecc663-5bad-4645-a040-ef27b70418e2 for MGC192.168.204.130@tcp 00000020:01000000:1.0:1787830263.828906:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.130@tcp (beecc663-5bad-4645-a040-ef27b70418e2) 00000020:01000000:1.0:1787830263.829905:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787830263.829915:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787830263.829925:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787830263.829945:0:21274:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f248233a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787830263.829953:0:21274:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9f248231cd28) has exports, disconnecting them 00000020:00080000:1.0:1787830263.829959:0:21274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f248233a800), last request at 1787830190 00000020:00000080:1.0:1787830263.829966:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1ddd 00000020:00080000:1.0:1787830263.829988:0:21274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248233a800): rc 0 00000020:00000080:1.0:1787830263.829993:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f248233a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787830263.830056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248233a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787830263.835886:0:21274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787830263.835901:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787830263.835921:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787830263.835929:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787830263.836214:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787830263.836227:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787830263.836235:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787830263.836241:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787830263.836246:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787830263.836258:0:21274:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f248233a000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787830263.836266:0:21274:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9f25bc778000) has exports, disconnecting them 00000020:00080000:0.0:1787830263.836271:0:21274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f248233a000), last request at 1787830190 00000020:00000080:0.0:1787830263.836276:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1df2 00000020:00080000:0.0:1787830263.836304:0:21274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f248233a000): rc 0 00000020:00000080:0.0:1787830263.836312:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f248233a000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787830263.836313:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f25b4920000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787830263.836325:0:8:0:(genops.c:885:class_export_put()) final put ffff9f248320e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787830263.836328:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248320e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787830263.836336:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787830263.836452:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248233a000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787830263.867309:0:21274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787830263.867337:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787830263.867343:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787830263.867353:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787830263.867413:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f24823f5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787830263.867489:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787830263.881805:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1787830263.882190:0:17077:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f25bc493000:17077] 0 exiting: rc = 1 00000100:00100000:1.0:1787830263.882292:0:17078:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f2483e0d400:17078] 1 exiting: rc = 0 00000100:00100000:3.0:1787830263.882418:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.882828:0:17081:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f2483c33c00:17081] 2 exiting: rc = 0 00000100:00100000:1.0:1787830263.883012:0:20233:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f24810cc400:20233] 3 exiting: rc = 0 00000100:00100000:1.0:1787830263.883179:0:17080:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f2483e0de00:17080] 1 exiting: rc = 0 00000100:00100000:0.0:1787830263.883263:0:17079:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f2483e0d600:17079] 0 exiting: rc = 1 00000100:00100000:3.0:1787830263.884972:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.884989:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.884998:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885005:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885042:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885061:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885069:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885075:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885081:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885087:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885093:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885099:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885105:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885111:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885118:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885124:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885130:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885136:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885142:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885148:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885154:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885159:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885164:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885171:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885178:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885186:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885198:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885210:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885216:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885221:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885227:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885233:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885239:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885244:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885249:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885255:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885260:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885265:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885269:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885282:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885288:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885293:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885298:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885305:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885311:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885317:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885323:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885328:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885334:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885340:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885346:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885351:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885366:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885372:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885377:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885383:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885388:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885393:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885398:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885404:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885408:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885413:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885419:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787830263.885424:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787830263.887041:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787830263.887056:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787830263.887064:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f24823f2800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787830263.887071:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff9f24823f2800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787830263.887078:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787830263.887148:0:21274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f248362d000 1 00000020:00000080:3.0:1787830263.887156:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8eaa8d1f2dfc1d97 00000020:00000080:3.0:1787830263.887164:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f2483307000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787830263.887187:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787830263.887202:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787830263.887209:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787830263.887213:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9f25872d4d28) has no exports 00000020:00000080:1.0:1787830263.887568:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2483307000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787830263.919453:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830263.919473:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787830263.919480:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f248362e800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787830263.919487:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248362e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787830263.919504:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787830263.920383:0:21274:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f248362b000 00000020:01000000:2.0:1787830263.920419:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787830263.920424:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787830263.920430:0:21274:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787830263.920435:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9f25b6078000) has no exports 00000020:00000080:2.0:1787830263.920463:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787830263.920471:0:21274:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787830263.920475:0:21274:0:(genops.c:885:class_export_put()) final put ffff9f248367c000/OSS_uuid 00000020:00000080:2.0:1787830263.920478:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff9f248367c000/OSS_uuid for OSS 00000020:01000000:2.0:1787830263.920483:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787830263.920699:0:18826:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f2587135800:18826] 3 exiting: rc = 0 00000100:00100000:1.0:1787830263.921010:0:18600:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f25bc494e00:18600] 2 exiting: rc = 0 00000100:00100000:1.0:1787830263.921095:0:18598:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f25bb565000:18598] 0 exiting: rc = 1 00000100:00100000:0.0:1787830263.921203:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f25bc495600:18599] 1 exiting: rc = 0 00000100:00100000:2.0:1787830263.921910:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921921:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921926:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921931:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921937:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921943:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921949:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921954:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921959:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921964:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921969:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921975:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921981:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921987:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921992:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.921999:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922005:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922010:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922016:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922022:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922027:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922033:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922051:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922057:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922064:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922070:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922077:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922083:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922089:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922095:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922103:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922109:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922115:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922126:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922149:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922155:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922160:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922166:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922172:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922178:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922184:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922190:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922195:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922202:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922209:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922214:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922220:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922224:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922230:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922235:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922241:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922247:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922252:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922258:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922264:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922271:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922277:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922282:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922289:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922294:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922300:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922305:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922311:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.922316:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1787830263.924465:0:17090:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787830263.925396:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f2582fd8200:18602] 0 exiting: rc = 1 00000100:00100000:1.0:1787830263.925518:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f2582fd9600:18603] 1 exiting: rc = 0 00000100:00100000:2.0:1787830263.925788:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925796:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925802:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925808:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925822:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925827:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925834:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925839:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925847:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925854:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925860:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925866:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925872:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925880:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925886:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925892:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925898:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925904:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925909:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925915:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925920:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925926:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925931:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925936:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925942:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925949:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925955:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925961:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925967:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925973:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925979:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925984:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925989:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.925995:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926001:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926008:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926013:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926019:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926024:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926182:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926192:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926199:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926206:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926212:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926218:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926225:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926230:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926235:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926241:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926246:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926253:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926259:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926265:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926271:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926277:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926283:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926289:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926295:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926300:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926306:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926311:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926318:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926324:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.926329:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.929774:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f2481ab6c00:18606] 2 exiting: rc = 0 00000100:00100000:3.0:1787830263.930194:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f25bc493a00:18605] 1 exiting: rc = 0 00000100:00100000:3.0:1787830263.930393:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f25b48a8000:18604] 0 exiting: rc = 1 00000100:00100000:2.0:1787830263.930615:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930634:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930642:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930648:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930655:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930670:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930678:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930685:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930691:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930715:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930721:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930831:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930837:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930844:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930851:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930857:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930864:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930869:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930875:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930880:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930886:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930892:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930899:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930904:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930912:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930918:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930925:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930930:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930936:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930942:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930961:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930969:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930974:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930981:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930987:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930993:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.930998:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931004:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931010:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931016:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931022:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931029:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931103:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931112:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931127:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931133:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931140:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931146:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931153:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931159:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931164:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931170:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931175:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931182:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931202:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931209:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931214:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931220:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931225:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931231:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931236:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931242:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931248:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.931267:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787830263.939613:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f2481ab7400:18608] 1 exiting: rc = 0 00000100:00100000:0.0:1787830263.939818:0:18607:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f2481ab6600:18607] 0 exiting: rc = 1 00000100:00100000:2.0:1787830263.940067:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940077:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940082:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940095:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940104:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940110:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940115:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940120:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940126:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940131:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940136:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940141:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940146:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940151:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940156:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940179:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940184:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940189:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940195:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940207:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940213:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940219:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940225:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940230:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940240:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940246:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940251:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940255:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940261:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940265:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940271:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940276:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940282:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940288:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940294:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940299:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940305:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940310:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940316:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940322:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940327:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940333:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940339:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940344:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940350:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940365:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940372:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940377:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940382:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940388:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940402:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940407:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940414:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940420:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940425:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940432:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940438:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940444:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940449:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940455:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940462:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940469:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940474:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.940480:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.942122:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f2587134800:18609] 0 exiting: rc = 1 00000100:00100000:1.0:1787830263.942507:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f2587135400:18610] 1 exiting: rc = 0 00000100:00100000:2.0:1787830263.943437:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943446:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943468:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943480:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943490:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943499:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943509:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943517:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943524:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943531:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943538:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943571:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943583:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943604:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943612:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943620:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943626:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943849:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943857:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943865:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943891:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943899:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943906:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943933:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943943:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943950:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943957:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943965:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943975:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943981:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943990:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.943997:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944003:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944009:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944017:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944119:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944129:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944138:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944146:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944155:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944162:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944168:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944175:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944181:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944188:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944195:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944203:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944226:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944234:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944242:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944249:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944257:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944263:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944270:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944276:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944292:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944299:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944306:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944314:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944336:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944344:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944350:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944370:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787830263.944386:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787830263.955495:0:21274:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787830287.996934:0:22039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787830298.110003:0:22640:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787830298.110011:0:22640:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787830298.110013:0:22640:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787830298.110311:0:22640:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f24833f4800 00000020:01000004:3.0:1787830298.110330:0:22640:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787830298.110338:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787830298.110354:0:22640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f25b6078000) 00000020:00000080:3.0:1787830298.110368:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787830298.165308:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787830298.165860:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787830298.168614:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787830298.168949:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787830298.169190:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787830298.169463:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787830298.169799:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787830298.170165:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787830298.170422:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787830298.170651:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.171750:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.172958:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.173930:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.174608:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.175079:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.175654:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.176276:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.176604:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.176982:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.177179:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.177782:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.178154:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.178552:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.178900:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.179311:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.179652:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.180141:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.180595:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.181033:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.181329:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.182534:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.182936:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787830298.183110:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.183544:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787830298.184328:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.187784:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787830298.188658:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.189082:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787830298.189506:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787830298.190052:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.190327:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.190570:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.190901:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787830298.191094:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787830298.191522:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.191943:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787830298.192167:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.193120:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.193658:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.194127:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.194921:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.195137:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787830298.195507:0:22640:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1787830298.196584:0:22640:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787830298.197346:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787830298.197356:0:22640:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787830298.198107:0:22640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc22de 00000020:01000004:0.0:1787830298.198119:0:22640:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787830298.198124:0:22640:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787830298.198130:0:22640:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f24833f4800 from MGS 00000020:01000004:0.0:1787830298.198135:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787830298.198147:0:22640:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f248231cd28) 00000020:00000080:0.0:1787830298.198161:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787830298.198291:0:22640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f24833f4800 from MGS, refs=2 00080000:01000000:0.0:1787830298.198297:0:22640:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787830298.198303:0:22640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc22ec 00000100:00100000:0.0:1787830298.198551:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787830298.198914:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787830298.198922:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787830298.199682:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787830298.199917:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787830298.201106:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787830298.201316:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787830298.201322:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787830298.202018:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787830298.202026:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787830298.202353:0:22640:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787830298.202360:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787830298.203493:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830298.203498:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830298.203500:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830298.203954:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830298.203957:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830298.203959:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830298.204658:0:22640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787830298.209322:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787830298.212175:0:22640:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787830298.213409:0:22652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787830298.213516:0:22640:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787830298.213560:0:22640:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787830298.214654:0:22640:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787830298.215327:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830298.215640:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787830298.215648:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787830298.220060:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787830298.220079:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787830298.220704:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787830298.220712:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787830298.221974:0:22657:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1787830298.222046:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787830298.222073:0:22640:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.130@tcp' 00000020:01000004:3.0:1787830298.222075:0:22640:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787830298.222106:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.130@tcp (typ=mgc) 00000020:00000080:3.0:1787830298.222119:0:22640:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.130@tcp (ffff9f25b607cd28) 00000020:00000080:3.0:1787830298.222134:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787830298.222226:0:22640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f24833f7800@MGC192.168.204.130@tcp: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1787830298.222583:0:22640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.130@tcp-0 is initialized 00000040:01000000:3.0:1787830298.222592:0:22640:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787830298.224040:0:22658:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787830298.224089:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.130@tcp (uuid 7f65c475-02cd-4018-98b1-85148034a57b) 00000020:00000080:3.0:1787830298.224112:0:22640:0:(genops.c:1385:class_connect()) connect: client 7f65c475-02cd-4018-98b1-85148034a57b, cookie 0x8eaa8d1f2dfc22fa 00000100:00080000:3.0:1787830298.224127:0:22640:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830298.224135:0:22640:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff9f24833f7800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830298.224171:0:22640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cf480 x1874675316797824/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830298.224205:0:22640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7f65c475-02cd-4018-98b1-85148034a57b->MGS 00000020:01000004:3.0:1787830298.224226:0:22640:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787830298.224231:0:22640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787830298.224250:0:22640:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f25b607b370) 00000020:00000080:3.0:1787830298.224262:0:22640:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787830298.237890:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f65c475-02cd-4018-98b1-85148034a57b:3636:1874675316797824:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787830298.237968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.238064:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316797824 00000100:00100000:2.0:1787830298.238081:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316797824 00000100:00100000:2.0:1787830298.238119:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830298.238127:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1874675316797824:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787830298.238180:0:22653:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7f65c475-02cd-4018-98b1-85148034a57b@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1787830298.245659:0:22653:0:(genops.c:1385:class_connect()) connect: client 7f65c475-02cd-4018-98b1-85148034a57b, cookie 0x8eaa8d1f2dfc2308 00000100:00080000:2.0:1787830298.249079:0:22653:0:(import.c:65:import_set_state_nolock()) ffff9f25bbcae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830298.250507:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+5:3636:x1874675316797824:12345-0@lo:250:mount.lustre.0 Request processed in 11068us (11228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830298.250522:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787830298.250593:0:3636:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787830298.250603:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.130@tcp: connect to target with instance 0 00000100:00080000:2.0:1787830298.250612:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787830298.250618:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787830298.250622:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f24833f7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787830298.250624:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787830298.250640:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787830298.250646:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f65c475-02cd-4018-98b1-85148034a57b:3636:1874675316797824:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787830298.257642:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830298.258126:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830298.258134:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787830298.259275:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787830298.259284:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787830298.259920:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787830298.259933:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787830298.260576:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830298.260902:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787830298.260908:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787830298.261661:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787830298.261669:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787830298.313173:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830298.313634:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787830298.313643:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787830298.315294:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787830298.315308:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787830298.326677:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830298.327160:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787830298.327166:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787830298.333888:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787830298.333907:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787830298.335208:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830298.335417:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787830298.335423:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787830298.336599:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787830298.336608:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787830298.340098:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830298.340289:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787830298.340295:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787830298.341277:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787830298.341286:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787830298.389544:0:22640:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830298.391059:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830298.391071:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787830298.394433:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787830298.394454:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787830298.404239:0:22640:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787830298.404340:0:22640:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787830298.405653:0:22640:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787830298.405684:0:22640:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787830298.405700:0:22640:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787830298.405831:0:22640:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787830298.405863:0:22640:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787830298.405868:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787830298.405870:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787830298.405871:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830298.405873:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830298.405874:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830298.405875:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830298.405876:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830298.405878:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787830298.405879:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830298.405881:0:22640:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787830298.405883:0:22640:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787830298.405885:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787830298.405889:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787830298.405890:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830298.405891:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830298.405892:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830298.405893:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830298.405893:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830298.405894:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787830298.405895:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830298.405896:0:22640:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787830298.405919:0:22640:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787830298.405940:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316797952:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787830298.406021:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830298.406063:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483c38840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.406406:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316797952 00000100:00100000:0.0:1787830298.406414:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316797952 00000100:00100000:0.0:1787830298.406476:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830298.406485:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+5:22640:x1874675316797952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787830298.406532:0:22656:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787830298.406535:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787830298.406539:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787830298.407866:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787830298.408488:0:22656:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787830298.411912:0:22677:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787830298.411921:0:22677:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787830298.411924:0:22677:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787830298.411926:0:22677:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787830298.412385:0:22677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787830298.413056:0:22656:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787830298.413068:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787830298.427037:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+5:22640:x1874675316797952:12345-0@lo:253:mount.lustre.0 Request processed in 20540us (21002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830298.427059:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830298.427160:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316797952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787830298.427198:0:22640:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787830298.427201:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787830298.427203:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787830298.427204:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830298.427206:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830298.427207:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830298.427208:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830298.427209:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830298.427210:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787830298.427212:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830298.427214:0:22640:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787830298.427233:0:22640:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f24833f4800 from lustre-MDT0000 10000000:01000000:0.0:1787830298.427260:0:22640:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787830298.427263:0:22640:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787830298.427267:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f25b607cd28 10000000:01000000:0.0:1787830298.427272:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787830298.427280:0:22640:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f25b607cd28 from 1 10000000:01000000:0.0:1787830298.427282:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787830298.427319:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.427329:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.427338:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830298.427355:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830298.427407:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830298.427450:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483c386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830298.427583:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798080 00000100:00100000:2.0:1787830298.427590:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798080 00000100:00100000:2.0:1787830298.427639:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787830298.427648:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+5:22640:x1874675316798080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830298.427662:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830298.427680:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c9200/0x8eaa8d1f2dfc2316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc230f expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830298.427713:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c9200/0x8eaa8d1f2dfc2316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc230f expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830298.427751:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c9200/0x8eaa8d1f2dfc2316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc230f expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830298.427760:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c9200, rc 0) 00000100:00100000:2.0:1787830298.427791:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+6:22640:x1874675316798080:12345-0@lo:101:mount.lustre.0 Request processed in 145us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830298.427797:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830298.428161:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830298.428176:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.428205:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830298.428290:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830298.428323:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830298.428351:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483c386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830298.428551:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798208 00000100:00100000:1.0:1787830298.428555:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798208 00000100:00100000:1.0:1787830298.428595:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830298.428604:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+6:22640:x1874675316798208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830298.428706:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+6:22640:x1874675316798208:12345-0@lo:501:mount.lustre.0 Request processed in 103us (382us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830298.428714:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830298.428893:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798208:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787830298.428929:0:22640:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787830298.428946:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.428955:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830298.428963:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f24833f4800 10000000:01000000:3.0:1787830298.428969:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787830298.428973:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f24833f4800 10000000:01000000:3.0:1787830298.428976:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787830298.428979:0:22640:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f24833f4800 from 1 10000000:01000000:3.0:1787830298.428981:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787830298.429005:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.429026:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.429035:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.429048:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830298.429078:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.429110:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830298.429571:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798336 00000100:00100000:1.0:1787830298.429578:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798336 00000100:00100000:1.0:1787830298.429620:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787830298.429629:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+6:22640:x1874675316798336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830298.429639:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830298.429662:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2580030e00/0x8eaa8d1f2dfc2324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc231d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.429681:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580030e00/0x8eaa8d1f2dfc2324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc231d expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.429702:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2580030e00/0x8eaa8d1f2dfc2324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc231d expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.429711:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2580030e00, rc 0) 00000100:00100000:1.0:1787830298.429795:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+7:22640:x1874675316798336:12345-0@lo:101:mount.lustre.0 Request processed in 167us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830298.429802:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830298.429906:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830298.429920:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2324 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.429929:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2324 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830298.429945:0:22640:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787830298.429958:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2324 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.429965:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1c00/0x8eaa8d1f2dfc231d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2324 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830298.429972:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787830298.429976:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830298.429982:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f24833f4800 10000000:01000000:3.0:1787830298.429984:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787830298.429998:0:22640:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787830298.430001:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787830298.430021:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.430029:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.430037:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.430051:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830298.430077:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.430105:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830298.430177:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798464 00000100:00100000:1.0:1787830298.430181:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798464 00000100:00100000:1.0:1787830298.430216:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830298.430224:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+7:22640:x1874675316798464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830298.430231:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830298.430239:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2580031c00/0x8eaa8d1f2dfc2332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc232b expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.430253:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580031c00/0x8eaa8d1f2dfc2332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc232b expref: 8 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.430261:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2580031c00/0x8eaa8d1f2dfc2332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc232b expref: 8 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.430268:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2580031c00, rc 0) 00000100:00100000:1.0:1787830298.430296:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+8:22640:x1874675316798464:12345-0@lo:101:mount.lustre.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830298.430310:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830298.430875:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830298.430888:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2332 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.430896:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2332 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.430963:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830298.430996:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.431017:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.431085:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798592 00000100:00100000:0.0:1787830298.431090:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798592 00000100:00100000:0.0:1787830298.431131:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830298.431140:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+8:22640:x1874675316798592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830298.431298:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+9:22640:x1874675316798592:12345-0@lo:501:mount.lustre.0 Request processed in 158us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.431305:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830298.431586:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830298.431616:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830298.431658:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.431704:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.431799:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798720 00000100:00100000:0.0:1787830298.431803:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798720 00000100:00100000:0.0:1787830298.431870:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830298.431878:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+9:22640:x1874675316798720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830298.436942:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+9:22640:x1874675316798720:12345-0@lo:503:mount.lustre.0 Request processed in 5047us (5265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.436958:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830298.437050:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316798720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830298.438705:0:22678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22678:1874675316798848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787830298.438833:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830298.438875:0:22678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2582dce180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830298.438984:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798848 00000100:00100000:2.0:1787830298.438992:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798848 00000100:00100000:2.0:1787830298.439044:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830298.439054:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+9:22678:x1874675316798848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.439935:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+9:22678:x1874675316798848:12345-0@lo:502:llog_process_th.0 Request processed in 878us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830298.439947:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787830298.440059:0:22678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22678:1874675316798848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787830298.440097:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830298.440108:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830298.440110:0:22678:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787830298.440116:0:22678:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787830298.440119:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830298.440134:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f25b60799b8) 00000020:00000080:3.0:1787830298.440154:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787830298.440161:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787830298.440261:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787830298.440270:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc2340 00000020:00000080:3.0:1787830298.440503:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787830298.440508:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830298.440511:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830298.440513:0:22678:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787830298.440516:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830298.440519:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830298.440521:0:22678:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787830298.440523:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830298.440535:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f2481b13370) 00000020:00000080:3.0:1787830298.440545:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787830298.440548:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787830298.440550:0:22678:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787830298.440553:0:22678:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787830298.440558:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787830298.440603:0:22678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f24833f4800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787830298.440615:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f2481b10000) 00000020:00000080:3.0:1787830298.440623:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787830298.440673:0:22678:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787830298.440697:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc2355 00000020:00000080:3.0:1787830298.440822:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787830298.440829:0:22678:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787830298.440833:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8eaa8d1f2dfc235c 00080000:01000000:3.0:1787830298.440838:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787830298.440842:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc2363 00010000:00010000:1.0:1787830298.520614:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787830298.521871:0:22678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:1.0:1787830298.522630:0:22678:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787830298.523290:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f25bc77cd28) 00000020:00000080:1.0:1787830298.523310:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787830298.524680:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787830298.524704:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc2371 00000020:00000080:1.0:1787830298.525903:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787830298.542020:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8eaa8d1f2dfc2378 00000020:00000080:1.0:1787830298.544050:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787830298.544065:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830298.544075:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830298.544078:0:22678:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787830298.544081:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787830298.544085:0:22678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787830298.544087:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787830298.544088:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787830298.544090:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787830298.544092:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830298.544093:0:22678:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787830298.544095:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830298.544100:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830298.544101:0:22678:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787830298.544106:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787830298.544155:0:22678:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787830298.544170:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830298.544178:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830298.544179:0:22678:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787830298.544182:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830298.544184:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830298.544185:0:22678:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787830298.544188:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787830298.544192:0:22678:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:1.0:1787830298.544217:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787830298.544233:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f25bc7799b8) 00000020:00000080:1.0:1787830298.544250:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787830298.544254:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787830298.544310:0:22678:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787830298.544314:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787830298.544320:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc2386 00010000:00080000:1.0:1787830298.544354:0:22678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f25bbd52000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1787830298.545939:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787830298.551252:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787830298.551266:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787830298.551302:0:22678:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787830298.551321:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc238d 00000100:00080000:3.0:1787830298.551331:0:22678:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830298.551337:0:22678:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f25bbd52000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830298.551671:0:22678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cd680 x1874675316798976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830298.551777:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316798976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787830298.551854:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787830298.551979:0:22678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787830298.552052:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830298.552057:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830298.552058:0:22678:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787830298.552061:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787830298.552064:0:22678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787830298.552066:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787830298.552067:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787830298.552068:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787830298.552071:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830298.552072:0:22678:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787830298.552075:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787830298.552080:0:22678:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787830298.552084:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830298.552085:0:22678:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787830298.552088:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787830298.552092:0:22678:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1787830298.552116:0:22678:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787830298.552131:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830298.552146:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f2481b119b8) 00000020:00000080:3.0:1787830298.552158:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787830298.552163:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787830298.552226:0:22678:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787830298.552233:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787830298.552239:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc239b 00010000:00080000:3.0:1787830298.552270:0:22678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f248233b800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1787830298.552668:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787830298.553037:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316798976 00000100:00100000:1.0:1787830298.553046:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316798976 00000100:00100000:1.0:1787830298.553087:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830298.553094:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316798976:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787830298.553110:0:22665:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787830298.557613:0:22678:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787830298.558100:0:22678:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787830298.566652:0:22678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830298.568096:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787830298.578329:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1787830298.586944:0:22684:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787830298.586953:0:22684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787830298.587640:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787830298.587652:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787830298.587711:0:22678:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787830298.587761:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc23a2 00000100:00080000:2.0:1787830298.587773:0:22678:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830298.587784:0:22678:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f248233b800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830298.587818:0:22678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836eed00 x1874675316799104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830298.587839:0:22678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787830298.587911:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830298.587916:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.587918:0:22678:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787830298.587920:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787830298.587923:0:22678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787830298.587924:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830298.587926:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830298.587927:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787830298.587929:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.587931:0:22678:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787830298.587933:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787830298.587937:0:22678:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787830298.587940:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.587941:0:22678:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787830298.587944:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787830298.587948:0:22678:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1787830298.587973:0:22678:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787830298.587975:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787830298.587987:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f25872d4d28) 00000020:00000080:2.0:1787830298.588000:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787830298.588004:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787830298.588076:0:22678:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787830298.588083:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787830298.588088:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8eaa8d1f2dfc23b0 00010000:00080000:2.0:1787830298.588121:0:22678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f25bc677000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787830298.588316:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787830298.588385:0:22678:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787830298.588412:0:22678:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787830298.589420:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316799104:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787830298.589514:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316799104 offset 0 length 520: 4 00000040:00080000:0.0:1787830298.599120:0:22678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830298.599539:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787830298.599662:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:1.0:1787830298.601864:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316798976:12345-0@lo:38:llog_process_th.0 Request processed in 48759us (50000us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787830298.601879:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787830298.601946:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830298.601952:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787830298.601956:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316798976:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787830298.603032:0:22686:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787830298.603041:0:22686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787830298.605664:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787830298.605680:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787830298.605781:0:22678:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787830298.605801:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc23b7 00000100:00080000:2.0:1787830298.605815:0:22678:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830298.605822:0:22678:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830298.605870:0:22678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ec000 x1874675316799232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830298.605897:0:22678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787830298.605953:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830298.605958:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.605960:0:22678:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787830298.605963:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830298.605967:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.605969:0:22678:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787830298.605972:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787830298.605974:0:22678:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787830298.605976:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830298.605978:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.605979:0:22678:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787830298.605981:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830298.605984:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.605985:0:22678:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787830298.605989:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787830298.606026:0:22678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22678:1874675316799360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.606123:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.606173:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316799360 00000100:00100000:2.0:1787830298.606180:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316799360 00000100:00100000:2.0:1787830298.606229:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830298.606238:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+9:22678:x1874675316799360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.606349:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+9:22678:x1874675316799360:12345-0@lo:502:llog_process_th.0 Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830298.606356:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830298.606405:0:22678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787830298.606429:0:22678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22678:1874675316799360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787830298.606456:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830298.606461:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830298.606463:0:22678:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787830298.606466:0:22678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787830298.606801:0:22640:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787830298.606825:0:22640:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787830298.606839:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2332 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.606850:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0200/0x8eaa8d1f2dfc232b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2332 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830298.606858:0:22640:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f24833f4800 from 1 10000000:01000000:3.0:1787830298.606860:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830298.606884:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.606891:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.606900:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.606913:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830298.606947:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.606965:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25832e8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.607221:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316799488 00000100:00100000:0.0:1787830298.607226:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316799488 00000100:00100000:0.0:1787830298.607268:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830298.607277:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+9:22640:x1874675316799488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830298.607288:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830298.607309:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc23be expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.607332:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.607342:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.607350:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1bbc00, rc 0) 00000100:00100000:0.0:1787830298.607401:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+10:22640:x1874675316799488:12345-0@lo:101:mount.lustre.0 Request processed in 126us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.607408:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787830298.607628:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316799232:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787830298.607669:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316799232 offset 0 length 520: 4 00000100:00100000:3.0:1787830298.608112:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830298.608129:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.608139:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.608769:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799616:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787830298.608810:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.608845:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25832e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830298.608955:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316799616 00000100:00100000:1.0:1787830298.608961:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316799616 00000100:00100000:1.0:1787830298.608992:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830298.608999:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+10:22640:x1874675316799616:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787830298.609016:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787830298.609022:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787830298.609096:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+10:22640:x1874675316799616:12345-0@lo:256:mount.lustre.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830298.609103:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830298.610735:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799616:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787830298.611288:0:22640:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830298.611301:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.611312:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830298.611321:0:22640:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f24833f4800 from 1 10000000:01000000:3.0:1787830298.611323:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787830298.611363:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.611371:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.611412:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.611433:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830298.611498:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.611558:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25832e8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.612037:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316799744 00000100:00100000:0.0:1787830298.612045:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316799744 00000100:00100000:0.0:1787830298.612110:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830298.612120:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+10:22640:x1874675316799744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830298.612135:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830298.612152:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc23cc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.612189:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 11 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.612200:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 11 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.612209:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1bb600, rc 0) 00000100:00100000:0.0:1787830298.612260:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+11:22640:x1874675316799744:12345-0@lo:101:mount.lustre.0 Request processed in 142us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.612268:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787830298.613786:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830298.613818:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.613833:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830298.613923:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830298.613976:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.614013:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25832e8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.616464:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316799872 00000100:00100000:0.0:1787830298.616479:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316799872 00000100:00100000:0.0:1787830298.616558:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787830298.616568:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+11:22640:x1874675316799872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830298.617241:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+11:22640:x1874675316799872:12345-0@lo:501:mount.lustre.0 Request processed in 672us (3261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.617251:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787830298.617583:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316799872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830298.617633:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830298.617699:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.617755:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830298.617805:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800000 00000100:00100000:1.0:1787830298.617810:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800000 00000100:00100000:1.0:1787830298.617845:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830298.617852:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+11:22640:x1874675316800000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830298.617940:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+11:22640:x1874675316800000:12345-0@lo:503:mount.lustre.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830298.617947:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830298.618015:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830298.620720:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22688:1874675316800128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.620832:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.620874:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830298.621167:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800128 00000100:00100000:3.0:1787830298.621174:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800128 00000100:00100000:3.0:1787830298.621218:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830298.621226:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+11:22688:x1874675316800128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787830298.625167:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+11:22688:x1874675316800128:12345-0@lo:502:llog_process_th.0 Request processed in 3930us (4324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830298.625182:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830298.626318:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22688:1874675316800128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830298.626380:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830298.626398:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626400:0:22688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787830298.626408:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f24833f4800 00000020:00000080:0.0:1787830298.626411:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830298.626420:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830298.626423:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626424:0:22688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787830298.626426:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830298.626442:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626444:0:22688:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787830298.626448:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f24833f4800 00000020:00000080:0.0:1787830298.626450:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830298.626528:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830298.626532:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626534:0:22688:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787830298.626536:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830298.626539:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626540:0:22688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787830298.626544:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f24833f4800 00000020:00000080:0.0:1787830298.626545:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830298.626567:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830298.626570:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626572:0:22688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787830298.626574:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830298.626576:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.626578:0:22688:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787830298.626581:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f24833f4800 00000020:00000080:0.0:1787830298.626583:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787830298.626633:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22688:1874675316800256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830298.626707:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830298.626787:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800256 00000100:00100000:0.0:1787830298.626793:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800256 00000100:00100000:0.0:1787830298.626845:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787830298.626854:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+11:22688:x1874675316800256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830298.626966:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+11:22688:x1874675316800256:12345-0@lo:502:llog_process_th.0 Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.626974:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787830298.635071:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25905c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.635124:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22688:1874675316800256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787830298.635193:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830298.635201:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830298.635204:0:22688:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787830298.635209:0:22688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787830298.635533:0:22640:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787830298.635564:0:22640:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787830298.635661:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.635674:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830298.635771:0:22640:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787830298.635775:0:22640:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f24833f4800 10000000:01000000:1.0:1787830298.635778:0:22640:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f24833f4800 10000000:01000000:1.0:1787830298.635788:0:22640:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787830298.635794:0:22640:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f24833f4800 from 1 10000000:01000000:1.0:1787830298.635797:0:22640:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787830298.635834:0:22640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.635843:0:22640:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.635854:0:22640:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830298.635879:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787830298.635952:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830298.635993:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483312540 going to sleep for 11 seconds 00000100:00100000:3.0:1787830298.636343:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800384 00000100:00100000:3.0:1787830298.636350:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800384 00000100:00100000:3.0:1787830298.636570:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830298.636587:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+11:22640:x1874675316800384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830298.636600:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830298.636613:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21d0800/0x8eaa8d1f2dfc23e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc23da expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.636635:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21d0800/0x8eaa8d1f2dfc23e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23da expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.636646:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21d0800/0x8eaa8d1f2dfc23e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23da expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830298.636654:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21d0800, rc 0) 00000100:00100000:3.0:1787830298.636710:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316800384:12345-0@lo:101:mount.lustre.0 Request processed in 125us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830298.636717:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787830298.636818:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830298.636831:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23e1 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.636840:0:22640:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc23e1 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830298.636893:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830298.636921:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830298.637243:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483312540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.637285:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800512 00000100:00100000:0.0:1787830298.637290:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800512 00000100:00100000:0.0:1787830298.637324:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830298.637332:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316800512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830298.638655:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316800512:12345-0@lo:501:mount.lustre.0 Request processed in 1318us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.638667:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830298.639358:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830298.639419:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830298.639474:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.639512:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.639549:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800640 00000100:00100000:0.0:1787830298.639557:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800640 00000100:00100000:0.0:1787830298.639606:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830298.639614:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316800640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830298.639789:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316800640:12345-0@lo:503:mount.lustre.0 Request processed in 175us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.639797:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787830298.639968:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316800640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830298.640668:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22691:1874675316800768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.640751:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.640785:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.657339:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800768 00000100:00100000:0.0:1787830298.657357:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800768 00000100:00100000:0.0:1787830298.657658:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787830298.657671:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:22691:x1874675316800768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787830298.657913:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:22691:x1874675316800768:12345-0@lo:502:llog_process_th.0 Request processed in 245us (17161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.657922:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787830298.658187:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22691:1874675316800768:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787830298.658266:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787830298.658287:0:22691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f25872d19b8) 00000020:00000080:2.0:1787830298.658309:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787830298.658623:0:22691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f24833f4800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787830298.658628:0:22691:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f24833f4800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787830298.658630:0:22691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f24833f4800 4 00010000:00080000:2.0:1787830298.658660:0:22691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2584dbe000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787830298.667654:0:22691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787830298.668021:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787830298.668080:0:22691:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787830298.668097:0:22691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8eaa8d1f2dfc23ef 00000100:00080000:2.0:1787830298.668110:0:22691:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830298.668117:0:22691:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f2584dbe000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830298.668163:0:22691:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ee940 x1874675316800896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830298.668194:0:22691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787830298.668348:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874675316800896:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787830298.674722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830298.676653:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316800896 00000100:00100000:3.0:1787830298.676667:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316800896 00000100:00100000:3.0:1787830298.676752:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830298.676760:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874675316800896:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787830298.676868:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874675316800896:12345-0@lo:38:llog_process_th.0 Request processed in 107us (2154us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787830298.676875:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830298.676926:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787830298.676937:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787830298.676942:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787830298.676946:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874675316800896:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787830298.677889:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22691:1874675316801024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.677970:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.678014:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830298.678034:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801024 00000100:00100000:2.0:1787830298.678040:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801024 00000100:00100000:2.0:1787830298.678088:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830298.678096:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:22691:x1874675316801024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.678221:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:22691:x1874675316801024:12345-0@lo:502:llog_process_th.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830298.678229:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830298.678275:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22691:1874675316801024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.678308:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22691:1874675316801152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.678337:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.678353:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830298.678450:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801152 00000100:00100000:2.0:1787830298.678455:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801152 00000100:00100000:2.0:1787830298.678478:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830298.678484:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:22691:x1874675316801152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787830298.678611:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:22691:x1874675316801152:12345-0@lo:502:llog_process_th.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830298.678617:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830298.678651:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f65c475-02cd-4018-98b1-85148034a57b:22691:1874675316801152:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787830298.678669:0:22691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787830298.678825:0:22640:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787830298.678851:0:22640:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787830298.678865:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23e1 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830298.678876:0:22640:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f2580031000/0x8eaa8d1f2dfc23da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc23e1 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787830298.678931:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787830298.678933:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787830298.678935:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830298.678937:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830298.678938:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830298.678939:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830298.678941:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830298.678942:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787830298.678944:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830298.678945:0:22640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787830298.678948:0:22640:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787830298.678950:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787830298.678952:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787830298.678953:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830298.678954:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830298.678955:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830298.678956:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830298.678957:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830298.678958:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787830298.678959:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830298.678960:0:22640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787830298.678973:0:22640:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787830298.678982:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316801280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787830298.679013:0:22640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830298.679029:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830298.679054:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801280 00000100:00100000:2.0:1787830298.679058:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801280 00000100:00100000:2.0:1787830298.679081:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787830298.679087:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316801280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787830298.680552:0:22656:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787830298.680573:0:22656:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787830298.694769:0:22656:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787830298.694791:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787830298.695240:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:22640:x1874675316801280:12345-0@lo:253:mount.lustre.0 Request processed in 16147us (16220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.695254:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:1.0:1787830298.695350:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787830298.695356:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787830298.695390:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.695418:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 11 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.695426:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.695464:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 11 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.695478:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 11 pid: 22656 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830298.695492:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316801408:0@lo:104: 00000100:00100000:1.0:1787830298.695530:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830298.695571:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483312480 going to sleep for 11 seconds 00000100:00100000:0.0:1787830298.695692:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801408 00000100:00100000:0.0:1787830298.695699:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801408 00000100:00100000:0.0:1787830298.695762:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830298.695770:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316801408:12345-0@lo:104: 00010000:00010000:0.0:1787830298.695782:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830298.695821:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830298.695826:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316801408:12345-0@lo:104: Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830298.695832:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830298.695984:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:22640:1874675316801280:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787830298.696007:0:22640:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787830298.696011:0:22640:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787830298.696013:0:22640:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787830298.696014:0:22640:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830298.696016:0:22640:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830298.696017:0:22640:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830298.696018:0:22640:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830298.696019:0:22640:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787830298.696021:0:22640:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787830298.696022:0:22640:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830298.696024:0:22640:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787830298.696042:0:22640:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787830298.698294:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830298.698313:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698326:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d1000 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:1.0:1787830298.698331:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698344:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830298.698351:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830298.698399:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830298.698463:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698470:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830298.698501:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698509:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1000/0x8eaa8d1f2dfc23be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc23c5 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698535:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830298.698537:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830298.698539:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830298.698586:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316801536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830298.698658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830298.698768:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801536 00000100:00100000:1.0:1787830298.698776:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801536 00010000:00010000:1.0:1787830298.698805:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 12 pid: 22656 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830298.698834:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830298.698843:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f65c475-02cd-4018-98b1-85148034a57b+12:3640:x1874675316801536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787830298.698857:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830298.698863:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 12 pid: 22656 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698875:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 12 pid: 22656 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698902:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698911:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787830298.698926:0:22646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003570164s 00010000:00010000:1.0:1787830298.698930:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698937:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698945:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698952:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698958:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580030a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830298.698963:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698970:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698979:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.698988:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830298.699025:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f65c475-02cd-4018-98b1-85148034a57b+12:3640:x1874675316801536:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830298.699037:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787830298.699081:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc23c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23be expref: 11 pid: 22656 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830298.699092:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316801408:0@lo:104: 00010000:00010000:1.0:1787830298.699116:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.699126:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.699131:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830298.699137:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580030a00/0x8eaa8d1f2dfc23f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830298.699164:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316801536:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787830298.751255:0:22640:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1787830298.751962:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787830298.752218:0:22701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787830298.752542:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1787830298.752997:0:22702:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f24836ed2c0 x1874675316801664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830298.753016:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000040:01000000:1.0:1787830298.753514:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787830298.753556:0:22640:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787830298.754009:0:22640:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787830298.754016:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787830298.754049:0:22640:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830298.754761:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787830298.757665:0:22640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:0.0:1787830298.757840:0:22700:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1787830298.757846:0:22700:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:1.0:1787830298.759092:0:22640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787830298.759147:0:22640:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787830298.760047:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787830298.760129:0:22701:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787830298.761082:0:22640:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1787830298.761810:0:22640:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1787830298.764149:0:22640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787830298.765887:0:22640:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787830298.765924:0:22640:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbbe501527988 00100000:10000000:2.0:1787830298.765932:0:22640:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787830298.767089:0:22640:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787830298.767106:0:22640:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787830298.767132:0:22640:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787830298.767157:0:22640:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787830298.771310:0:22640:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787830298.774712:0:22640:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787830299.261087:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787830299.711462:0:22696:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787830299.711473:0:22696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787830299.718559:0:22696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787830299.718575:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787830299.774858:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 10000000:01000000:0.0:1787830299.902095:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787830299.902104:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f24833f4800 from 11 10000000:01000000:0.0:1787830299.902109:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787830299.902162:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830299.902177:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830299.902203:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830299.902233:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316801792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830299.902317:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830299.902376:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25905c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830299.902510:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801792 00000100:00100000:1.0:1787830299.902522:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801792 00000100:00100000:1.0:1787830299.902587:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787830299.902598:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+11:22658:x1874675316801792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830299.902622:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830299.902638:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc23fd expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830299.902677:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830299.902689:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830299.902699:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2580030800, rc 0) 00000100:00100000:1.0:1787830299.902760:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:22658:x1874675316801792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830299.902767:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787830299.902815:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316801792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830299.902831:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830299.902853:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830299.902912:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316801920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787830299.902946:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830299.902959:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb5dea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830299.903132:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801920 00000100:00100000:0.0:1787830299.903137:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801920 00000100:00100000:0.0:1787830299.903171:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830299.903179:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:22658:x1874675316801920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787830299.903194:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787830299.903211:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787830299.903214:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787830299.903284:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:22658:x1874675316801920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830299.903293:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787830299.903467:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316801920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787830299.903520:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787830299.903528:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830299.903543:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830300.284858:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787830300.733101:0:22696:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787830300.733112:0:22696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787830300.733254:0:22696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1787830300.733457:0:22696:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787830300.734116:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787830300.799563:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787830301.314227:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830301.822993:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787830302.335010:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830302.851968:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:2.0:1787830303.365385:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830303.869504:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000100:00080000:2.0:1787830303.998065:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787830303.998072:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787830303.998076:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830303.998084:0:14982:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:2.0:1787830303.998089:0:14982:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787830303.998095:0:14982:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f25bbd52000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830303.998117:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ecb40 x1874675316802176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830303.998129:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830303.998133:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830303.998135:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830303.998138:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830303.998147:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787830303.998150:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787830303.998152:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830303.998157:0:14982:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f2584dbe000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830303.998169:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ec780 x1874675316802304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830303.998379:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316802048:0@lo:400:kworker.0 00000100:00100000:3.0:1787830303.998496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830303.998594:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316802048 00000100:00100000:3.0:1787830303.998602:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316802048 00000100:00100000:2.0:1787830304.002680:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802176:0@lo:38:kworker.0 00000100:00100000:2.0:1787830304.002826:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830304.002871:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874675316802304:0@lo:38:kworker.0 00000100:00100000:2.0:1787830304.002923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830304.003244:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830304.003266:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:3637:x1874675316802048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830304.003848:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316802176 00000100:00100000:1.0:1787830304.003858:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316802176 00000100:00100000:1.0:1787830304.003902:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787830304.003909:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874675316802176:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787830304.003930:0:22666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787830304.003984:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874675316802176:12345-0@lo:38:kworker.0 Request processed in 74us (1158us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787830304.003991:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787830304.004117:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830304.004122:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787830304.004126:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802176:0@lo:38:kworker.0 00000100:00100000:3.0:1787830304.004447:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:3637:x1874675316802048:12345-0@lo:400:kworker.0 Request processed in 1191us (5949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830304.004456:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830304.004911:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316802304 00000100:00100000:0.0:1787830304.004918:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316802304 00000100:00100000:0.0:1787830304.004946:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830304.004953:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874675316802304:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787830304.004977:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:0.0:1787830304.005016:0:22662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8eaa8d1f2dfc240b 00000004:00100000:0.0:1787830304.005031:0:22662:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787830304.005171:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9f2482655000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830304.005242:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874675316802304:12345-0@lo:38:kworker.0 Request processed in 288us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830304.005249:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830304.005861:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316802048:0@lo:400:kworker.0 00010000:00080000:1.0:1787830304.005995:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f24836ec780 x1874675316802304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830304.006012:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787830304.006020:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787830304.006025:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787830304.006028:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2584dbe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787830304.006034:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874675316802304:0@lo:38:kworker.0 00000001:02000400:0.0:1787830304.126203:0:22945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787830304.381441:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830304.896652:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000020:00000004:2.0:1787830305.375271:0:22997:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830305.375893:0:22997:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787830305.405905:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830305.922585:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000020:00000004:1.0:1787830306.345973:0:23047:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830306.346131:0:23047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787830306.428889:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830306.940813:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:2.0:1787830307.457350:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830307.965997:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000100:00100000:2.0:1787830308.092893:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830298/real 1787830298] req@ffff9f24836ec000 x1874675316799232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830308 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830308.093087:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f24836ec000 x1874675316799232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830308 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830308.093098:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830298/real 1787830298] req@ffff9f24836eed00 x1874675316799104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830308 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830308.093111:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f24836eed00 x1874675316799104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830308 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787830308.093149:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830308.093174:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787830308.093179:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316799232:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787830308.093196:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830308.093203:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787830308.093206:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316799104:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787830308.093357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787830308.093361:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787830308.093364:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830308.093369:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:3.0:1787830308.093374:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787830308.093380:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f25bbd52000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830308.093402:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928ccb40 x1874675316802560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830308.093431:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830308.093435:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787830308.093436:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830308.093439:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:3.0:1787830308.093442:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787830308.093445:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f248233b800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830308.093457:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cc3c0 x1874675316802688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830308.093466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830308.093469:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830308.093470:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830308.093474:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:3.0:1787830308.093482:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787830308.093487:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830308.093510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cf0c0 x1874675316802816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830308.093566:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316802944:0@lo:400:kworker.0 00000100:00100000:3.0:1787830308.093707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830308.093820:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316802944 00000100:00100000:3.0:1787830308.093829:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316802944 00000100:00100000:3.0:1787830308.094127:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787830308.094137:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316802944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830308.094190:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316802944:12345-0@lo:400:kworker.0 Request processed in 54us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830308.094197:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787830308.094662:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f25928ccf00 x1874675316802944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830308.094676:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316802944:0@lo:400:kworker.0 00000100:00100000:1.0:1787830308.094859:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802560:0@lo:38:kworker.0 00000100:00100000:1.0:1787830308.095079:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830308.095111:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802688:0@lo:8:kworker.0 00000400:00000100:1.0:1787830308.095140:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316802688 offset 0 length 520: 4 00000100:00100000:1.0:1787830308.095167:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802816:0@lo:8:kworker.0 00000400:00000100:1.0:1787830308.095193:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316802816 offset 0 length 520: 4 00000100:00100000:0.0:1787830308.095362:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316802432:0@lo:400:kworker.0 00000100:00100000:0.0:1787830308.095402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830308.095465:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316802432 00000100:00100000:0.0:1787830308.095471:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316802432 00000100:00100000:0.0:1787830308.095519:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830308.095527:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:3638:x1874675316802432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830308.095568:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+12:3638:x1874675316802432:12345-0@lo:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830308.095574:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830308.095613:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316802432:0@lo:400:kworker.0 00000100:00100000:3.0:1787830308.095873:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316802560 00000100:00100000:3.0:1787830308.095877:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316802560 00000100:00100000:2.0:1787830308.096102:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787830308.096109:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316802560:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787830308.096127:0:22665:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787830308.096172:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316802560:12345-0@lo:38:kworker.0 Request processed in 62us (1093us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787830308.096179:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787830308.096468:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830308.096474:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830308.096477:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802560:0@lo:38:kworker.0 00010000:00010000:1.0:1787830308.476971:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830308.988859:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787830309.500899:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830310.012948:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787830310.524933:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787830310.974383:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787830311.041268:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787830311.550617:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830312.070935:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787830312.581780:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830313.087647:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000100:00080000:2.0:1787830313.217888:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787830313.217897:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787830313.217902:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830313.217913:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1787830313.217922:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787830313.217931:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f25bbd52000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830313.217966:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836eda40 x1874675316803200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830313.218012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830313.218016:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830313.218020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830313.218023:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830313.218074:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316803328:0@lo:400:kworker.0 00000100:00100000:2.0:1787830313.218172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830313.218250:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830313.218268:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803328 00000100:00100000:2.0:1787830313.218277:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803328 00000100:00100000:2.0:1787830313.218339:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830313.218349:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316803328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830313.218425:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316803328:12345-0@lo:400:kworker.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830313.218433:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830313.218469:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316803200:0@lo:38:kworker.0 00000100:00100000:2.0:1787830313.218503:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830313.218542:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803200 00000100:00100000:2.0:1787830313.218546:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803200 00000100:00100000:2.0:1787830313.218571:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830313.218577:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316803200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787830313.218599:0:22665:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787830313.218637:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316803200:12345-0@lo:38:kworker.0 Request processed in 59us (133us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787830313.218643:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787830313.218684:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787830313.218696:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787830313.218700:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316803200:0@lo:38:kworker.0 00010000:00080000:2.0:1787830313.218760:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f24836ee1c0 x1874675316803328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830313.218773:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316803328:0@lo:400:kworker.0 00000100:00100000:0.0:1787830313.218952:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316803072:0@lo:400:kworker.0 00000100:00100000:0.0:1787830313.219000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830313.219277:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803072 00000100:00100000:1.0:1787830313.219284:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803072 00000100:00100000:1.0:1787830313.219337:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787830313.219346:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:3639:x1874675316803072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830313.219395:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:3639:x1874675316803072:12345-0@lo:400:kworker.0 Request processed in 50us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830313.219414:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787830313.219455:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316803072:0@lo:400:kworker.0 00010000:00010000:2.0:1787830313.596963:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830314.108897:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787830314.621220:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787830314.941908:0:23392:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787830314.941914:0:23392:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787830314.941916:0:23392:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787830314.942266:0:23392:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f25896b5800 00000020:01000004:3.0:1787830314.942284:0:23392:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787830314.942388:0:23392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787830314.942423:0:23392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f2481b14d28) 00000020:00000080:3.0:1787830314.942440:0:23392:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787830315.047829:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787830315.048303:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.063072:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.064238:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.064560:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.065323:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.065632:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.066066:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.066463:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.066770:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.067538:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.067908:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.068233:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.069341:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.069690:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.070246:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.071615:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.072937:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.073705:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.074216:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.074707:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.075225:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.075521:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.075756:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.076245:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.078120:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.079023:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.079440:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.081056:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.083983:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.084983:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.087467:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.089639:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787830315.094248:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787830315.095606:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787830315.096530:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787830315.096973:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787830315.097697:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787830315.098828:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787830315.099609:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787830315.099900:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787830315.100411:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787830315.100762:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787830315.101264:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787830315.101620:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787830315.102396:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787830315.104099:0:23392:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787830315.104396:0:23392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787830315.104408:0:23392:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787830315.104424:0:23392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8eaa8d1f2dfc2419 00000020:01000004:1.0:1787830315.104432:0:23392:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787830315.104457:0:23392:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787830315.104461:0:23392:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787830315.104467:0:23392:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787830315.104498:0:23392:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787830315.104502:0:23392:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787830315.113991:0:23392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787830315.114065:0:23392:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787830315.114070:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787830315.114072:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787830315.114073:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830315.114074:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830315.114076:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830315.114077:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830315.114078:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830315.114080:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830315.114081:0:23392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830315.114085:0:23392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787830315.114087:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787830315.114088:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787830315.114089:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830315.114090:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830315.114091:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830315.114092:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830315.114093:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830315.114095:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830315.114096:0:23392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787830315.114127:0:23392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787830315.114148:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787830315.114236:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.118886:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803456 00000100:00100000:3.0:1787830315.118905:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803456 00000100:00100000:3.0:1787830315.119452:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787830315.119466:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:23392:x1874675316803456:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787830315.119509:0:22653:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787830315.119513:0:22653:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787830315.119522:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787830315.120534:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787830315.123557:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+12:23392:x1874675316803456:12345-0@lo:253:mount.lustre.0 Request processed in 4080us (9305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830315.123575:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787830315.123685:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787830315.123722:0:23392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787830315.123765:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787830315.123766:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787830315.123768:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830315.123769:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830315.123779:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830315.123780:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830315.123782:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787830315.123784:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830315.123785:0:23392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787830315.123809:0:23392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f25896b5800 from lustre-MDT0001 10000000:01000000:2.0:1787830315.123838:0:23392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787830315.123841:0:23392:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787830315.123848:0:23392:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f25b607cd28 local copy 00010000:00010000:2.0:1787830315.123858:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.123963:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830315.123998:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.124844:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.124992:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803584 00000100:00100000:0.0:1787830315.125003:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803584 00000100:00100000:0.0:1787830315.125072:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830315.125081:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:23392:x1874675316803584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830315.125199:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:23392:x1874675316803584:12345-0@lo:501:mount.lustre.0 Request processed in 119us (1200us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787830315.125207:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787830315.125307:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787830315.125329:0:23392:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787830315.125353:0:23392:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787830315.125374:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.125386:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.125427:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f25896b5800 10000000:01000000:2.0:1787830315.125450:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787830315.125456:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f25b607cd28 10000000:01000000:2.0:1787830315.125458:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787830315.125461:0:23392:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f25b607cd28 from 1 10000000:01000000:2.0:1787830315.125464:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787830315.125498:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.125506:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.125517:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.125537:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830315.125571:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.125595:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.125936:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803712 00000100:00100000:0.0:1787830315.125943:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803712 00000100:00100000:0.0:1787830315.125975:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830315.125982:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+12:23392:x1874675316803712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830315.125992:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830315.126007:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc2427 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc2420 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.126030:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc2427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2420 expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.126041:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1bbc00/0x8eaa8d1f2dfc2427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2420 expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.126049:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1bbc00, rc 0) 00000100:00100000:0.0:1787830315.126104:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+13:23392:x1874675316803712:12345-0@lo:101:mount.lustre.0 Request processed in 122us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.126111:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787830315.126259:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830315.126272:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2427 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.126281:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2427 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.126309:0:23392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787830315.126341:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2427 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.126348:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9400/0x8eaa8d1f2dfc2420 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2427 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.126379:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f25896b5800 10000000:01000000:2.0:1787830315.126383:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787830315.126388:0:23392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f25896b5800 from 1 10000000:01000000:2.0:1787830315.126390:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787830315.126408:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.126415:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.126422:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.126436:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830315.126470:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.126492:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.126613:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803840 00000100:00100000:0.0:1787830315.126618:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803840 00000100:00100000:0.0:1787830315.126639:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830315.126646:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+13:23392:x1874675316803840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830315.126661:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830315.126670:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bba00/0x8eaa8d1f2dfc2435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc242e expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.126685:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bba00/0x8eaa8d1f2dfc2435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc242e expref: 14 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.126693:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1bba00/0x8eaa8d1f2dfc2435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc242e expref: 14 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.126700:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1bba00, rc 0) 00000100:00100000:0.0:1787830315.126761:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+14:23392:x1874675316803840:12345-0@lo:101:mount.lustre.0 Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.126768:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787830315.127704:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830315.127740:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2435 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.127751:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2435 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.127769:0:23392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787830315.127789:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2435 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.127796:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9e00/0x8eaa8d1f2dfc242e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2435 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.127815:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787830315.127820:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787830315.127825:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f25896b5800 10000000:01000000:2.0:1787830315.127827:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787830315.127831:0:23392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787830315.127833:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787830315.127856:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.127862:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.127870:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.127886:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830315.127939:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.127970:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.129641:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316803968 00000100:00100000:0.0:1787830315.129654:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316803968 00000100:00100000:0.0:1787830315.129705:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830315.129712:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+14:23392:x1874675316803968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830315.129750:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830315.129767:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bb400/0x8eaa8d1f2dfc2443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc243c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.129803:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bb400/0x8eaa8d1f2dfc2443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc243c expref: 15 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.129814:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1bb400/0x8eaa8d1f2dfc2443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc243c expref: 15 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.129822:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1bb400, rc 0) 00000100:00100000:0.0:1787830315.129902:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316803968:12345-0@lo:101:mount.lustre.0 Request processed in 190us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.129909:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787830315.131356:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316803968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830315.131394:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2443 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.131406:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2443 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830315.133526:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787830315.134585:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830315.140385:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787830315.140456:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787830315.140472:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787830315.140499:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787830315.140515:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787830315.140528:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787830315.140540:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787830315.140552:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787830315.140565:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787830315.140580:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787830315.140594:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787830315.140607:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787830315.140621:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787830315.140633:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787830315.140645:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787830315.140658:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787830315.140672:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1787830315.140685:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1787830315.140698:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1787830315.140709:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1787830315.140721:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787830315.141453:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787830315.141482:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787830315.141497:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787830315.141513:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787830315.141526:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787830315.141540:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787830315.141552:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787830315.141565:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787830315.141580:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787830315.141594:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787830315.141608:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787830315.141625:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787830315.141639:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787830315.141669:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787830315.141683:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787830315.141698:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787830315.141713:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787830315.141769:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000100:00100000:3.0:1787830315.141942:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000040:00080000:2.0:1787830315.142664:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787830315.142683:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787830315.142700:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787830315.142714:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787830315.142764:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787830315.142812:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787830315.142819:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787830315.142939:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830315.143011:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830315.143337:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804096 00000100:00100000:1.0:1787830315.143346:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804096 00000100:00100000:1.0:1787830315.143421:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787830315.143432:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830315.143643:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804096:12345-0@lo:501:mount.lustre.0 Request processed in 213us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830315.143653:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787830315.143948:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.143972:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830315.144024:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830315.144265:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.144441:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830315.144546:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804224 00000100:00100000:3.0:1787830315.144553:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804224 00000100:00100000:3.0:1787830315.144637:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787830315.144647:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830315.145715:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804224:12345-0@lo:503:mount.lustre.0 Request processed in 1065us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.145751:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787830315.145850:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804224:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787830315.146894:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787830315.147019:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830315.147102:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.147989:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830315.148242:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804352 00000100:00100000:1.0:1787830315.148254:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804352 00000100:00100000:1.0:1787830315.148315:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787830315.148325:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830315.149503:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804352:12345-0@lo:502:mount.lustre.0 Request processed in 1174us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830315.149514:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787830315.149637:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830315.149924:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787830315.149959:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1787830315.149985:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1787830315.149998:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1787830315.150025:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1787830315.150041:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1787830315.150053:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1787830315.150076:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1787830315.150089:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1787830315.150673:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1787830315.150702:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1787830315.150715:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1787830315.150764:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1787830315.150845:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1787830315.150863:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1787830315.150879:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1787830315.150893:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1787830315.150904:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1787830315.150920:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1787830315.150932:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1787830315.150945:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1787830315.150956:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1787830315.150968:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1787830315.150981:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1787830315.150994:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1787830315.151007:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1787830315.151139:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1787830315.151155:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1787830315.151172:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1787830315.151187:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1787830315.151443:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1787830315.151462:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1787830315.151475:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1787830315.151488:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1787830315.151500:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1787830315.151530:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1787830315.151543:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1787830315.151556:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1787830315.151569:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1787830315.151584:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1787830315.151600:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1787830315.151615:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1787830315.151628:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1787830315.151641:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1787830315.151690:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830315.152909:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.152965:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804480 00000100:00100000:2.0:1787830315.152973:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804480 00000100:00100000:2.0:1787830315.153382:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830315.153398:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830315.153583:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316804480:12345-0@lo:502:mount.lustre.0 Request processed in 189us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830315.153591:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830315.153660:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2583e7cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.153689:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316804480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830315.153902:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1787830315.153919:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1787830315.155664:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830315.155684:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.155687:0:23396:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787830315.155695:0:23396:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787830315.155698:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830315.155720:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f258954b370) 00000020:00000080:3.0:1787830315.155804:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1787830315.155812:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787830315.155927:0:23396:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787830315.155935:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8eaa8d1f2dfc2451 00000020:00000080:3.0:1787830315.156483:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787830315.156490:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830315.156495:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.156503:0:23396:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787830315.156509:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830315.156513:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.156515:0:23396:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787830315.156518:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830315.156529:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f25895499b8) 00000020:00000080:3.0:1787830315.156543:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787830315.156548:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787830315.156550:0:23396:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787830315.156552:0:23396:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787830315.156558:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787830315.156614:0:23396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f25896b5800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787830315.156625:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f2589548000) 00000020:00000080:3.0:1787830315.156633:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787830315.156714:0:23396:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787830315.156722:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc2466 00000020:00000080:3.0:1787830315.156935:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787830315.156943:0:23396:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787830315.156949:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8eaa8d1f2dfc246d 00080000:01000000:3.0:1787830315.156955:0:23396:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787830315.156960:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8eaa8d1f2dfc2474 00010000:00010000:3.0:1787830315.255909:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787830315.256864:0:23396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1787830315.257469:0:23396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787830315.258621:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787830315.258635:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830315.258642:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.258644:0:23396:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787830315.258648:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830315.258654:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.258655:0:23396:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787830315.258659:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787830315.258665:0:23396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:0.0:1787830315.258696:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830315.258711:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f248231b370) 00000020:00000080:0.0:1787830315.258761:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787830315.258768:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787830315.258834:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787830315.258841:0:23396:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787830315.258848:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8eaa8d1f2dfc2482 00010000:00080000:0.0:1787830315.258883:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2481a49000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1787830315.260596:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787830315.262595:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787830315.262609:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787830315.262646:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787830315.262678:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc2489 00000100:00080000:3.0:1787830315.262690:0:23396:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830315.262696:0:23396:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f2481a49000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830315.262751:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cda40 x1874675316804608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830315.262793:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787830315.262857:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830315.262861:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.262863:0:23396:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787830315.262867:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787830315.262869:0:23396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787830315.262871:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787830315.262873:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787830315.262875:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787830315.262877:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.262878:0:23396:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787830315.262881:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830315.262886:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.262887:0:23396:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787830315.262891:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787830315.262923:0:23396:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787830315.262939:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830315.262944:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.262946:0:23396:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787830315.262949:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787830315.262952:0:23396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787830315.262953:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787830315.262955:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787830315.262957:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787830315.262960:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.262962:0:23396:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787830315.262965:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787830315.262968:0:23396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787830315.262972:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830315.262973:0:23396:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787830315.262977:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787830315.262982:0:23396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1787830315.263015:0:23396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787830315.263020:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830315.263033:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f258954cd28) 00000020:00000080:3.0:1787830315.263063:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787830315.263071:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787830315.263153:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787830315.263161:0:23396:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787830315.263168:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8eaa8d1f2dfc2497 00010000:00080000:3.0:1787830315.263333:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2481a4a000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1787830315.263578:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1787830315.263719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787830315.263752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787830315.263851:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787830315.263858:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 702 00000100:00080000:1.0:1787830315.263861:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787830315.263866:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f25bbd52000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787830315.263891:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bd29b840 x1874675316804736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787830315.263903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.263906:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830315.263909:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.263912:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787830315.264081:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316804608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787830315.264159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.264217:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316804736:0@lo:38:kworker.0 00000100:00100000:0.0:1787830315.264241:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.264285:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804608 00000100:00100000:0.0:1787830315.264293:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804608 00000100:00100000:0.0:1787830315.264318:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804736 00000100:00100000:0.0:1787830315.264321:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804736 00000100:00100000:0.0:1787830315.264335:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830315.264351:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316804608:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787830315.264389:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:0.0:1787830315.264427:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc249e 00000004:00100000:0.0:1787830315.264444:0:22665:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787830315.264454:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787830315.264873:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874675316804864:0@lo:400:kworker.0 00000100:00100000:3.0:1787830315.264917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.264963:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804864 00000100:00100000:3.0:1787830315.264968:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804864 00000100:00100000:3.0:1787830315.265009:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830315.265018:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874675316804864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830315.265338:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874675316804864:12345-0@lo:400:kworker.0 Request processed in 319us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.265346:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:0.0:1787830315.265972:0:23396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00010000:00080000:3.0:1787830315.266423:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f25bd299680 x1874675316804864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830315.266440:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd299680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874675316804864:0@lo:400:kworker.0 00000040:01000000:1.0:1787830315.270931:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1787830315.275571:0:22665:0:(import.c:65:import_set_state_nolock()) ffff9f25865b2800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787830315.276023:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787830315.276437:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1787830315.276500:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874675316804608:12345-0@lo:38:llog_process_th.0 Request processed in 12144us (12336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830315.276512:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830315.276550:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830315.276556:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316804736:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787830315.276616:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874675316804736:12345-0@lo:38:kworker.0 Request processed in 59us (12373us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787830315.276624:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1787830315.276650:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1787830315.276781:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830315.276791:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787830315.276799:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787830315.276805:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787830315.276808:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481a49000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787830315.276825:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316804608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787830315.276841:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830315.276846:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830315.276850:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787830315.276853:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316804736:0@lo:38:kworker.0 00000100:00100000:0.0:1787830315.277007:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316804992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830315.277050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.277088:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316804992 00000100:00100000:0.0:1787830315.277093:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316804992 00000100:00100000:0.0:1787830315.277127:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830315.277134:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874675316804992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787830315.277159:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787830315.277564:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874675316804992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 429us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.277583:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787830315.277712:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316804992:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787830315.278156:0:23401:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787830315.278161:0:23401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787830315.279382:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787830315.279397:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787830315.279440:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787830315.279464:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc24a5 00000100:00080000:2.0:1787830315.279483:0:23396:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830315.279489:0:23396:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f2481a4a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830315.279519:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836eda40 x1874675316805120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830315.279548:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787830315.279685:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316805120:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787830315.279793:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316805120 offset 0 length 520: 4 00000020:01000000:2.0:1787830315.280521:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830315.280528:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.280530:0:23396:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787830315.280533:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787830315.280536:0:23396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787830315.280537:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830315.280539:0:23396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787830315.280540:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787830315.280542:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.280544:0:23396:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787830315.280546:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787830315.280551:0:23396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787830315.280554:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.280555:0:23396:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787830315.280558:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787830315.280561:0:23396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1787830315.280590:0:23396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787830315.280592:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787830315.280617:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f25872d3370) 00000020:00000080:2.0:1787830315.280634:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787830315.280640:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787830315.280742:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787830315.280749:0:23396:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787830315.280755:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8eaa8d1f2dfc24b3 00010000:00080000:2.0:1787830315.280793:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2481b0a000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787830315.281031:0:23396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787830315.281118:0:23396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787830315.281135:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787830315.281940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.281946:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830315.281949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.281951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787830315.286047:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830315.286984:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787830315.287145:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1787830315.290449:0:23403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787830315.290461:0:23403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787830315.292102:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787830315.292116:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787830315.292161:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787830315.292188:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc24ba 00000100:00080000:2.0:1787830315.292201:0:23396:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830315.292207:0:23396:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830315.292243:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ecf00 x1874675316805248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830315.292303:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316805248:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787830315.292371:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316805248 offset 0 length 520: 4 00000100:00080000:2.0:1787830315.292430:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787830315.292538:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830315.292542:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.292545:0:23396:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787830315.292548:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830315.292562:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.292564:0:23396:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787830315.292573:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787830315.292575:0:23396:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787830315.292578:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830315.292580:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.292581:0:23396:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787830315.292583:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787830315.292586:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.292587:0:23396:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787830315.292591:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787830315.292628:0:23396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787830315.292632:0:23396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787830315.292633:0:23396:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787830315.292636:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1787830315.292695:0:23392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787830315.292750:0:23392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787830315.292767:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2443 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.292777:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c8800/0x8eaa8d1f2dfc243c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2443 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.292786:0:23392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f25896b5800 from 1 10000000:01000000:2.0:1787830315.292789:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787830315.292814:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.292823:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.292834:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.292850:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830315.292895:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.292915:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.292936:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316805376 00000100:00100000:2.0:1787830315.292942:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316805376 00000100:00100000:2.0:1787830315.292984:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830315.292993:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+15:23392:x1874675316805376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830315.293007:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830315.293019:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc24c1 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.293042:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.293052:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.293061:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c9800, rc 0) 00000100:00100000:2.0:1787830315.293097:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+16:23392:x1874675316805376:12345-0@lo:101:mount.lustre.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830315.293103:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830315.293144:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830315.293156:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.293165:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.293710:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805504:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787830315.293796:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.293813:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7780 going to sleep for 11 seconds 00000100:00100000:3.0:1787830315.294043:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316805504 00000100:00100000:3.0:1787830315.294049:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316805504 00000100:00100000:3.0:1787830315.294089:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787830315.294097:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+16:23392:x1874675316805504:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787830315.294113:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787830315.294130:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787830315.294133:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787830315.294210:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+16:23392:x1874675316805504:12345-0@lo:256:mount.lustre.0 Request processed in 114us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.294218:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787830315.294894:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805504:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787830315.295489:0:23392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787830315.295547:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.295568:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830315.295576:0:23392:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f25896b5800 from 1 10000000:01000000:2.0:1787830315.295579:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830315.295618:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.295626:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.295635:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830315.295651:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830315.295691:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.295815:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316805632 00000100:00100000:3.0:1787830315.295821:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316805632 00000100:00100000:3.0:1787830315.295857:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787830315.295866:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+16:23392:x1874675316805632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830315.295877:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830315.295888:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc24cf expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.295907:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.295917:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.295927:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21d1e00, rc 0) 00000100:00100000:3.0:1787830315.295956:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316805632:12345-0@lo:101:mount.lustre.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.295963:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787830315.296060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.296065:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830315.296068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.296071:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830315.296210:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.296227:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830315.296238:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830315.296263:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830315.297613:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787830315.297974:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830315.298782:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787830315.298822:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787830315.298839:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787830315.298855:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787830315.298871:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787830315.298887:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787830315.298904:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787830315.298918:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787830315.298932:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787830315.298949:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787830315.298965:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787830315.298987:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787830315.298994:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1787830315.301916:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830315.301992:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.302047:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.303624:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316805760 00000100:00100000:2.0:1787830315.303639:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316805760 00000100:00100000:3.0:1787830315.304881:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787830315.304902:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316805760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830315.305478:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316805760:12345-0@lo:501:mount.lustre.0 Request processed in 583us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.305487:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787830315.305595:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830315.305661:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830315.306929:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830315.307103:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316805888 00000100:00100000:1.0:1787830315.307112:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316805888 00000100:00100000:1.0:1787830315.307186:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787830315.307204:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316805888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830315.307718:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316805888:12345-0@lo:503:mount.lustre.0 Request processed in 514us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830315.307816:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830315.308484:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830315.308518:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316805888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787830315.309977:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830315.310189:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830315.310271:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.310489:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.310538:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806016 00000100:00100000:2.0:1787830315.310546:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806016 00000100:00100000:3.0:1787830315.311219:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830315.311232:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316806016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830315.311416:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316806016:12345-0@lo:502:mount.lustre.0 Request processed in 187us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.311425:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787830315.311565:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830315.311848:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787830315.311881:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1787830315.311907:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1787830315.311922:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1787830315.311943:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1787830315.311962:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1787830315.311978:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1787830315.311994:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1787830315.312022:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787830315.312041:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1787830315.312055:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1787830315.312089:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830315.312133:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830315.312160:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830315.312581:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806144 00000100:00100000:1.0:1787830315.312589:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806144 00000100:00100000:1.0:1787830315.312636:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787830315.312645:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316806144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830315.312795:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316806144:12345-0@lo:502:mount.lustre.0 Request processed in 150us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830315.312802:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830315.313129:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830315.313186:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1787830315.313198:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787830315.315174:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830315.315188:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315191:0:23405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787830315.315201:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f25896b5800 00000020:00000080:0.0:1787830315.315204:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830315.315211:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830315.315213:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315215:0:23405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787830315.315217:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830315.315219:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315220:0:23405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787830315.315223:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f25896b5800 00000020:00000080:0.0:1787830315.315226:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830315.315411:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830315.315415:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315417:0:23405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787830315.315420:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830315.315423:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315425:0:23405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787830315.315428:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f25896b5800 00000020:00000080:0.0:1787830315.315430:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830315.315451:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830315.315454:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315455:0:23405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787830315.315458:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787830315.315471:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315472:0:23405:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787830315.315477:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f25896b5800 00000020:00000080:0.0:1787830315.315479:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787830315.315507:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787830315.315510:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830315.315511:0:23405:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787830315.315514:0:23405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787830315.317152:0:23392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787830315.317199:0:23392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787830315.317263:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.317276:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830315.317346:0:23392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787830315.317349:0:23392:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f25896b5800 10000000:01000000:3.0:1787830315.317352:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f25896b5800 10000000:01000000:3.0:1787830315.317356:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787830315.317372:0:23392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f25896b5800 from 1 10000000:01000000:3.0:1787830315.317382:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787830315.317423:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.317432:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.317443:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830315.317468:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787830315.317542:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.317591:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830315.318947:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806272 00000100:00100000:1.0:1787830315.318959:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806272 00000100:00100000:1.0:1787830315.319024:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787830315.319035:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:23392:x1874675316806272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830315.319049:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830315.319065:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2580031e00/0x8eaa8d1f2dfc24e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc24dd expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830315.319097:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580031e00/0x8eaa8d1f2dfc24e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24dd expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830315.319108:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2580031e00/0x8eaa8d1f2dfc24e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24dd expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830315.319118:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2580031e00, rc 0) 00000100:00100000:1.0:1787830315.319189:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806272:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830315.319197:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787830315.319403:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830315.319429:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24e4 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.319441:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc24e4 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787830315.323769:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1787830315.324699:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830315.324948:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1787830315.324975:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1787830315.324989:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1787830315.325002:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1787830315.325016:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1787830315.325029:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1787830315.325751:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1787830315.325789:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1787830315.325803:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1787830315.325816:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1787830315.325829:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1787830315.325844:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1787830315.325857:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1787830315.325869:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1787830315.325881:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1787830315.325905:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1787830315.325919:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1787830315.325931:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1787830315.325944:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1787830315.325958:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1787830315.325972:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1787830315.325986:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1787830315.325998:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1787830315.326009:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1787830315.326039:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1787830315.326076:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1787830315.326092:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1787830315.326103:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1787830315.326116:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1787830315.326128:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1787830315.326139:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1787830315.326151:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1787830315.326162:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1787830315.326175:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1787830315.326187:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1787830315.326215:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1787830315.326228:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1787830315.326256:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1787830315.326271:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1787830315.326284:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1787830315.326312:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1787830315.326328:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1787830315.326341:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1787830315.326354:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1787830315.326380:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1787830315.326394:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1787830315.326407:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1787830315.326497:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1787830315.326661:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1787830315.326683:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1787830315.326700:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1787830315.326705:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1787830315.326847:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830315.326913:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.326958:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806400 00000100:00100000:0.0:1787830315.326964:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806400 00000100:00100000:0.0:1787830315.327010:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787830315.327019:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830315.327135:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806400:12345-0@lo:501:mount.lustre.0 Request processed in 117us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.327143:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787830315.327187:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.327208:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830315.327255:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830315.327291:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.327315:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806528 00000100:00100000:0.0:1787830315.327319:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806528 00000100:00100000:0.0:1787830315.327342:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787830315.327349:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830315.328127:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806528:12345-0@lo:503:mount.lustre.0 Request processed in 773us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.328138:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787830315.328295:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.328315:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787830315.329548:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787830315.329771:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830315.329835:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.329881:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806656 00000100:00100000:0.0:1787830315.329887:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806656 00000100:00100000:0.0:1787830315.329926:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787830315.329934:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830315.330912:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806656:12345-0@lo:502:mount.lustre.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.330927:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787830315.330996:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2590769cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.331021:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830315.331282:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1787830315.331312:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1787830315.331326:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1787830315.331339:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1787830315.331353:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1787830315.331380:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1787830315.331394:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1787830315.331406:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1787830315.331678:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1787830315.331700:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1787830315.331716:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1787830315.331747:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1787830315.331767:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1787830315.331779:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1787830315.331793:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1787830315.331807:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1787830315.331834:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1787830315.331847:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1787830315.331877:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1787830315.331895:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1787830315.331906:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1787830315.331918:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1787830315.331931:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1787830315.331945:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1787830315.331958:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1787830315.331971:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1787830315.331989:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1787830315.332000:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1787830315.332012:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1787830315.332025:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1787830315.332037:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1787830315.332047:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1787830315.332243:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1787830315.332264:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1787830315.332291:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1787830315.332307:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1787830315.332320:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1787830315.332332:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1787830315.332345:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1787830315.332358:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1787830315.332386:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1787830315.332398:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1787830315.332410:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1787830315.332580:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1787830315.332601:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1787830315.332612:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1787830315.332624:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1787830315.332634:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1787830315.332691:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830315.332792:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.332833:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806784 00000100:00100000:0.0:1787830315.332840:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806784 00000100:00100000:0.0:1787830315.332895:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830315.332903:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830315.333006:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806784:12345-0@lo:502:mount.lustre.0 Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.333014:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787830315.334373:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2590769cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.334410:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830315.335915:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787830315.336822:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787830315.336911:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830315.336988:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.337034:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316806912 00000100:00100000:0.0:1787830315.337051:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316806912 00000100:00100000:0.0:1787830315.337395:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830315.337405:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830315.337527:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316806912:12345-0@lo:502:mount.lustre.0 Request processed in 123us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.337535:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787830315.337583:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2590769cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.337603:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316806912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830315.337659:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787830315.337669:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787830315.338937:0:23409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787830315.338955:0:23409:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f2590484d28) 00000020:00000080:3.0:1787830315.338979:0:23409:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787830315.339919:0:23409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f25896b5800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787830315.339926:0:23409:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f25896b5800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787830315.339929:0:23409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f25896b5800 3 00010000:00080000:3.0:1787830315.339976:0:23409:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f25bfb3d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1787830315.343897:0:23409:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787830315.344106:0:23409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787830315.344152:0:23409:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787830315.344167:0:23409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8eaa8d1f2dfc24f2 00000100:00080000:3.0:1787830315.344181:0:23409:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787830315.344188:0:23409:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f25bfb3d000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830315.344229:0:23409:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cc780 x1874675316807040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830315.344258:0:23409:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787830315.344896:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874675316807040:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787830315.345631:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.346894:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807040 00000100:00100000:3.0:1787830315.346910:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807040 00000100:00100000:3.0:1787830315.346954:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830315.346964:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874675316807040:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787830315.346991:0:22661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:3.0:1787830315.347028:0:22661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8eaa8d1f2dfc24f9 00000004:00100000:3.0:1787830315.347062:0:22661:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830315.347097:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9f258541e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830315.347169:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874675316807040:12345-0@lo:38:llog_process_th.0 Request processed in 205us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830315.347176:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787830315.347236:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f25928cc780 x1874675316807040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830315.347247:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787830315.347257:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787830315.347266:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787830315.347270:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787830315.347273:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bfb3d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787830315.347279:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874675316807040:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787830315.347848:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.347854:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830315.347857:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830315.347860:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787830315.347995:0:23409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1787830315.348128:0:23392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787830315.348324:0:23392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787830315.348347:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24e4 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.348371:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1400/0x8eaa8d1f2dfc24dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc24e4 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787830315.348427:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787830315.348429:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787830315.348430:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830315.348431:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830315.348433:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830315.348434:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830315.348435:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830315.348437:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830315.348438:0:23392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787830315.348442:0:23392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787830315.348445:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830315.348446:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787830315.348447:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830315.348448:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830315.348449:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830315.348450:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830315.348451:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787830315.348451:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830315.348452:0:23392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787830315.348900:0:23392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787830315.348922:0:23392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316807168:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787830315.348981:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.349018:0:23392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.349501:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807168 00000100:00100000:0.0:1787830315.349508:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807168 00000100:00100000:0.0:1787830315.349551:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787830315.349559:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316807168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787830315.349596:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787830315.349617:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787830315.355221:0:22641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787830315.356413:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787830315.356430:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787830315.356507:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787830315.356513:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787830315.356536:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.356557:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.356567:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.356575:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.356621:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.356634:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 18 pid: 22656 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830315.356652:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316807296:0@lo:104: 00000100:00100000:0.0:1787830315.356741:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830315.356793:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.356816:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 18 pid: 22655 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830315.356849:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316807424:0@lo:104: 00000100:00100000:0.0:1787830315.356878:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.356900:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2590769b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.356980:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807296 00000100:00100000:0.0:1787830315.356987:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807296 00000100:00100000:0.0:1787830315.357023:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807424 00000100:00100000:0.0:1787830315.357025:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807424 00000100:00100000:0.0:1787830315.357037:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830315.357045:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316807296:12345-0@lo:104: 00010000:00010000:0.0:1787830315.357057:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357108:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830315.357115:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316807296:12345-0@lo:104: Request processed in 71us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.357121:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830315.357138:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830315.357144:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316807424:12345-0@lo:104: 00010000:00010000:0.0:1787830315.357151:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357223:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830315.357229:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316807424:12345-0@lo:104: Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.357235:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787830315.357251:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830315.357257:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357272:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9a00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830315.357276:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357285:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830315.357293:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830315.357299:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787830315.357329:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357336:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830315.357377:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357385:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25906c9a00/0x8eaa8d1f2dfc24c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc24c8 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357398:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830315.357402:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357407:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1ba800 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830315.357410:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357426:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830315.357432:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830315.357438:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787830315.357450:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316807552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830315.357455:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357462:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830315.357480:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357488:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc23fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2404 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830315.357493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830315.357512:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830315.357514:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830315.357516:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830315.357567:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807552 00000100:00100000:3.0:1787830315.357573:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807552 00000100:00100000:0.0:1787830315.357579:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:23392:x1874675316807168:12345-0@lo:253:mount.lustre.0 Request processed in 8019us (8596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.357589:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787830315.357605:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 18 pid: 22656 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357621:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830315.357635:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787830315.357645:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f65c475-02cd-4018-98b1-85148034a57b+18:3640:x1874675316807552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830315.357650:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316807680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830315.357657:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830315.357665:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 18 pid: 22656 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830315.357677:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 18 pid: 22656 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830315.357681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830315.357699:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830315.357752:0:22647:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787830315.357761:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f65c475-02cd-4018-98b1-85148034a57b+18:3640:x1874675316807552:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.357761:0:22647:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787830315.357771:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830315.357782:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807680 00000100:00100000:0.0:1787830315.357792:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807680 00010000:00010000:0.0:1787830315.357809:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 18 pid: 22655 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830315.357813:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316807552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830315.357841:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830315.357849:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f65c475-02cd-4018-98b1-85148034a57b+18:3637:x1874675316807680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830315.357858:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830315.357862:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 18 pid: 22655 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357872:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 18 pid: 22655 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357884:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357892:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787830315.357905:0:22648:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003570164s 00010000:00010000:0.0:1787830315.357909:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357915:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357922:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357928:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357945:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830315.357949:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357957:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357966:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.357975:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830315.358007:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f65c475-02cd-4018-98b1-85148034a57b+18:3637:x1874675316807680:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.358015:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830315.358128:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316807680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830315.358160:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25906c9800/0x8eaa8d1f2dfc24c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24c1 expref: 17 pid: 22656 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830315.358170:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316807296:0@lo:104: 00010000:00010000:0.0:1787830315.358183:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23fd expref: 16 pid: 22655 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830315.358192:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316807424:0@lo:104: 00010000:00010000:0.0:1787830315.358211:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.358221:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.358235:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830315.358241:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1bb000/0x8eaa8d1f2dfc2500 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830315.358457:0:23392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:23392:1874675316807168:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787830315.358470:0:23392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787830315.358473:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787830315.358476:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787830315.358477:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830315.358478:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830315.358480:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830315.358481:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830315.358483:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787830315.358485:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830315.358486:0:23392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787830315.358497:0:23392:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1787830315.372091:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787830315.372178:0:23416:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787830315.372183:0:23416:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787830315.372403:0:23417:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787830315.372607:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1787830315.372967:0:23417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787830315.373676:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787830315.373715:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787830315.374889:0:23392:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787830315.374901:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787830315.374974:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830315.376499:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787830315.376592:0:23417:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787830315.376798:0:23419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23419:1874675316807808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787830315.376873:0:23419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.376925:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807808 00000100:00100000:0.0:1787830315.376932:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807808 00000100:00100000:0.0:1787830315.376981:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830315.376990:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23419:x1874675316807808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787830315.377076:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23419:x1874675316807808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.377085:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830315.377120:0:23419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f248353b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.377150:0:23419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23419:1874675316807808:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787830315.377191:0:23419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787830315.377683:0:23392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787830315.378255:0:23392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787830315.378287:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787830315.378407:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787830315.378943:0:23419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23419:1874675316807936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787830315.379006:0:23419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.379052:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316807936 00000100:00100000:0.0:1787830315.379060:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316807936 00000100:00100000:0.0:1787830315.379104:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830315.379113:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23419:x1874675316807936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787830315.379220:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23419:x1874675316807936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.379228:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830315.379249:0:23419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f248353b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787830315.379269:0:23419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23419:1874675316807936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787830315.379328:0:23419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23419:1874675316808064:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787830315.379378:0:23419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830315.379413:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808064 00000100:00100000:0.0:1787830315.379417:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808064 00000100:00100000:0.0:1787830315.379444:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830315.379451:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23419:x1874675316808064:12345-0@lo:900:lod0001_rec0000.0 00080000:10000000:1.0:1787830315.380029:0:23392:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1787830315.380427:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23419:x1874675316808064:12345-0@lo:900:lod0001_rec0000.0 Request processed in 973us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830315.380438:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00000004:1.0:1787830315.389023:0:23392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787830315.390838:0:23419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f248353bb40 going to sleep for 11 seconds 00010000:00080000:3.0:1787830315.390888:0:23419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f25b66fe580 x1874675316808064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787830331 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830315.390905:0:23419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23419:1874675316808064:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787830315.391001:0:23419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23419:1874675316808192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787830315.391087:0:23419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830315.391119:0:23419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a0a34240 going to sleep for 11 seconds 00000100:00100000:2.0:1787830315.398031:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808192 00000100:00100000:2.0:1787830315.398049:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808192 00000100:00100000:2.0:1787830315.398116:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830315.398128:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23419:x1874675316808192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787830315.398274:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23419:x1874675316808192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 148us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830315.398294:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830315.398536:0:23419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23419:1874675316808192:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787830315.398608:0:23419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830315.402152:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787830315.402240:0:23419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787830315.402246:0:23419:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1787830315.405775:0:23392:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787830315.405814:0:23392:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbbe501c87988 00100000:10000000:1.0:1787830315.405822:0:23392:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787830315.406407:0:23392:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787830315.406444:0:23392:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787830315.406467:0:23392:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787830315.406492:0:23392:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787830315.417766:0:23392:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787830315.418103:0:23392:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787830315.648407:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830316.160384:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 10000000:01000000:1.0:1787830316.414667:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787830316.414674:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f25896b5800 from 12 10000000:01000000:1.0:1787830316.414680:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787830316.414745:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830316.415684:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830316.415699:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830316.415820:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830316.415898:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830316.415947:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584ccc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830316.416820:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808320 00000100:00100000:0.0:1787830316.416832:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808320 00000100:00100000:0.0:1787830316.416893:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787830316.416903:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+16:22658:x1874675316808320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830316.416919:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830316.416937:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc2507 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830316.416975:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830316.416987:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830316.416998:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1bb800, rc 0) 00000040:00080000:3.0:1787830316.417868:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787830316.418980:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316808320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2073us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830316.418992:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787830316.419180:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830316.419206:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.419218:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830316.419287:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787830316.419352:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830316.419388:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830316.419407:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808448 00000100:00100000:3.0:1787830316.419412:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808448 00000100:00100000:3.0:1787830316.420636:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787830316.420653:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316808448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787830316.420678:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787830316.420694:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787830316.420697:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787830316.420825:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316808448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830316.420833:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787830316.420883:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787830316.420932:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830316.420946:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.420956:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830316.420968:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830316.420971:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f24833f4800 from 12 10000000:01000000:3.0:1787830316.420974:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830316.421000:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421009:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421019:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830316.421038:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830316.421070:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830316.421094:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830316.421109:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808576 00000100:00100000:3.0:1787830316.421113:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808576 00000100:00100000:3.0:1787830316.421140:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787830316.421146:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316808576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830316.421154:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830316.421167:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc2515 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421189:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421207:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421215:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21d0c00, rc 0) 00000100:00100000:3.0:1787830316.421245:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316808576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830316.421252:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787830316.421285:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830316.421297:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421306:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830316.421361:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787830316.421389:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830316.421404:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830316.421415:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808704 00000100:00100000:3.0:1787830316.421418:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808704 00000100:00100000:3.0:1787830316.421454:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830316.421461:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316808704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787830316.421471:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787830316.421482:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787830316.421485:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787830316.421548:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316808704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830316.421565:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830316.421597:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316808704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787830316.421631:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830316.421636:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830316.421643:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830316.669132:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830317.181834:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000040:00080000:2.0:1787830317.438968:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830317.696928:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830318.204841:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787830318.717606:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830319.230392:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787830319.746701:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787830320.189359:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787830320.274358:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 0 seconds 00000100:00080000:2.0:1787830320.381420:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787830320.381428:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787830320.381432:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787830320.381444:0:14982:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f25bbd52000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830320.381471:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ecb40 x1874675316808960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830320.381487:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830320.381490:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830320.381493:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830320.381496:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830320.381516:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830320.381519:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830320.381522:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830320.381525:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830320.381552:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316808832:0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.381622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830320.381664:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830320.381670:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316809344:0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.381696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830320.381735:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316808960:0@lo:38:kworker.0 00000100:00100000:2.0:1787830320.381758:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830320.381782:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316809088:0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.381801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830320.381815:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787830320.381819:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316809216:0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.381927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830320.381963:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808832 00000100:00100000:2.0:1787830320.381977:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808832 00000100:00100000:2.0:1787830320.382031:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830320.382039:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:3638:x1874675316808832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.382089:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:3638:x1874675316808832:12345-0@lo:400:kworker.0 Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830320.382096:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830320.382128:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809344 00000100:00100000:2.0:1787830320.382133:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809344 00000100:00100000:2.0:1787830320.382158:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809088 00000100:00100000:2.0:1787830320.382161:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809088 00000100:00100000:2.0:1787830320.382252:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830320.382258:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316809344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.382303:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316809344:12345-0@lo:400:kworker.0 Request processed in 45us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830320.382309:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830320.382320:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830320.382326:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316809088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.382357:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316809088:12345-0@lo:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830320.382363:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830320.382379:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316808960 00000100:00100000:2.0:1787830320.382383:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316808960 00000100:00100000:2.0:1787830320.382393:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809216 00000100:00100000:2.0:1787830320.382396:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809216 00000100:00100000:2.0:1787830320.382411:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830320.382415:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874675316808960:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787830320.382442:0:22666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:2.0:1787830320.382479:0:22666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc2523 00000004:00100000:2.0:1787830320.382502:0:22666:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787830320.382508:0:22666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1787830320.382623:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f24836efc00 x1874675316809088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830320.382638:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316809088:0@lo:400:kworker.0 00010000:00080000:2.0:1787830320.382683:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f24836ee940 x1874675316809344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830320.382691:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316809344:0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.382699:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316808832:0@lo:400:kworker.0 00000100:00100000:2.0:1787830320.383015:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830320.383026:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316809472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830320.383063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830320.384002:0:22665:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787830320.384015:0:22665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787830320.384972:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809472 00000100:00100000:0.0:1787830320.384984:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809472 00000100:00100000:0.0:1787830320.385128:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830320.385138:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258a17a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1874675316809216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830320.385238:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258a17a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1874675316809216:12345-0@lo:400:kworker.0 Request processed in 101us (3310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830320.385244:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830320.385271:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830320.385279:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316809472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787830320.385305:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787830320.385351:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316809472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830320.385356:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787830320.385644:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316809472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830320.385682:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316809216:0@lo:400:kworker.0 00000100:00080000:3.0:1787830320.397676:0:22666:0:(import.c:65:import_set_state_nolock()) ffff9f25905e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830320.397792:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874675316808960:12345-0@lo:38:kworker.0 Request processed in 15373us (16030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830320.397803:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787830320.397883:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787830320.397894:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787830320.397901:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787830320.397904:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bbd52000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787830320.397919:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000067cf619d): req@ffff9f24836ed2c0 x1874675316801664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830320.397938:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316808960:0@lo:38:kworker.0 00000100:00100000:3.0:1787830320.398053:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830320.398079:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bc4b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830320.398095:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316801664 00000100:00100000:3.0:1787830320.398111:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316801664 00000100:00100000:3.0:1787830320.398150:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830320.398158:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874675316801664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787830320.398434:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874675316801664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 276us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830320.398441:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830320.398461:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830320.398472:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316809600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830320.398497:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830320.398532:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ed2c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874675316801664:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787830320.398566:0:22702:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787830320.398599:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874675316809728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787830320.398628:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830320.398642:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830320.398658:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809600 00000100:00100000:3.0:1787830320.398661:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809600 00000100:00100000:3.0:1787830320.398677:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809728 00000100:00100000:3.0:1787830320.398679:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809728 00000100:00100000:3.0:1787830320.398691:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787830320.398696:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874675316809600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830320.398719:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787830320.398777:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874675316809600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830320.398783:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787830320.398795:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830320.398802:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874675316809728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787830320.399039:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874675316809728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 238us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830320.399046:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830320.399079:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316809600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830320.399104:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874675316809728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787830320.399249:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874675316809856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787830320.399286:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830320.399302:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830320.399315:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809856 00000100:00100000:3.0:1787830320.399318:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809856 00000100:00100000:3.0:1787830320.399337:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787830320.399343:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874675316809856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787830320.399392:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874675316809856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830320.399398:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787830320.399423:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874675316809856:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787830320.399467:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830320.402357:0:22702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787830320.402447:0:22702:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:3.0:1787830320.402452:0:22702:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787830320.773138:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787830321.030454:0:23664:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787830321.793878:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830322.080486:0:23716:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830322.080759:0:23716:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787830322.814016:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787830323.203298:0:23766:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787830323.205971:0:23766:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787830323.453288:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830308/real 1787830308] req@ffff9f25928cc3c0 x1874675316802688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830323 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830323.453325:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25928cc3c0 x1874675316802688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830323 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830323.453336:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830308/real 1787830308] req@ffff9f25928cf0c0 x1874675316802816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830323 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830323.453347:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25928cf0c0 x1874675316802816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830323 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830323.453365:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830323.453444:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787830323.453448:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802688:0@lo:8:kworker.0 00000100:00080000:1.0:1787830323.453455:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787830323.455299:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316809984:0@lo:400:kworker.0 00000100:00100000:3.0:1787830323.455391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830323.455492:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316809984 00000100:00100000:2.0:1787830323.455500:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316809984 00000100:00100000:2.0:1787830323.455555:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830323.455566:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:3640:x1874675316809984:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787830323.455661:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830323.455666:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787830323.455669:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830323.455674:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:0.0:1787830323.455678:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787830323.455683:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f248233b800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830323.455705:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b66fd680 x1874675316810240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830323.455716:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830323.455719:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787830323.455721:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830323.455743:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:0.0:1787830323.455745:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787830323.455749:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830323.455762:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b66fd2c0 x1874675316810368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830323.458181:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:3640:x1874675316809984:12345-0@lo:400:kworker.0 Request processed in 2607us (2781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830323.458197:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830323.458284:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316810112:0@lo:400:kworker.0 00000100:00100000:2.0:1787830323.458363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830323.458408:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830323.458414:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316810496:0@lo:400:kworker.0 00000100:00100000:2.0:1787830323.458441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830323.458477:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316810496 00000100:00100000:2.0:1787830323.458485:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316810496 00000100:00100000:2.0:1787830323.458531:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830323.458539:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316810496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830323.458593:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316810496:12345-0@lo:400:kworker.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830323.458600:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787830323.458641:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25b66ff480 x1874675316810496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830323.458656:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316810496:0@lo:400:kworker.0 00000100:00080000:1.0:1787830323.459906:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787830323.459914:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316802816:0@lo:8:kworker.0 00000100:00100000:1.0:1787830323.459946:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316810240:0@lo:8:kworker.0 00000400:00000100:1.0:1787830323.459989:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316810240 offset 0 length 520: 4 00000100:00100000:1.0:1787830323.460024:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316810368:0@lo:8:kworker.0 00000400:00000100:1.0:1787830323.460040:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316810368 offset 0 length 520: 4 00000100:00080000:0.0:1787830323.462422:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830323.462433:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830323.462435:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830323.462458:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830323.462511:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830323.462514:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830323.462517:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830323.462519:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787830323.462577:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316810624:0@lo:400:kworker.0 00000100:00100000:0.0:1787830323.462641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830323.462684:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830323.462690:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874675316810752:0@lo:400:kworker.0 00000100:00100000:0.0:1787830323.462717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830323.462796:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316810112 00000100:00100000:0.0:1787830323.462811:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316810112 00000100:00100000:0.0:1787830323.462874:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316810624 00000100:00100000:0.0:1787830323.462878:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316810624 00000100:00100000:0.0:1787830323.462896:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830323.462904:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874675316810112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830323.462962:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874675316810112:12345-0@lo:400:kworker.0 Request processed in 59us (4599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830323.462969:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830323.462987:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830323.462993:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316810624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830323.463026:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316810624:12345-0@lo:400:kworker.0 Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830323.463032:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830323.463066:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316810624:0@lo:400:kworker.0 00000100:00100000:2.0:1787830323.463252:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316810752 00000100:00100000:2.0:1787830323.463257:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316810752 00000100:00100000:2.0:1787830323.463294:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830323.463301:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874675316810752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830323.463345:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874675316810752:12345-0@lo:400:kworker.0 Request processed in 45us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830323.463351:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830323.463380:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316810112:0@lo:400:kworker.0 00010000:00080000:2.0:1787830323.463409:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25b66fc3c0 x1874675316810752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830323.463420:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874675316810752:0@lo:400:kworker.0 00000100:00100000:3.0:1787830323.463970:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316809984:0@lo:400:kworker.0 00010000:00010000:0.0:1787830323.836971:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787830324.622825:0:23814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce2cc4ad0 20000000:00000080:2.0:1787830324.622852:0:23814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f25b8520400 uarg=0000000000000000 20000000:01000000:2.0:1787830324.622927:0:23814:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787830324.622938:0:23814:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787830324.622944:0:23814:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787830324.626405:0:23815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787830324.626556:0:23814:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787830324.637980:0:23814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787830324.638139:0:23814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830324.638176:0:23814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830324.638196:0:23814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830324.638206:0:23814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830324.638276:0:23814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830324.638296:0:23814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 17 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830324.638315:0:23814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ed2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874675316810880:0@lo:104: 00000100:00100000:2.0:1787830324.638409:0:23814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830324.638486:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316810880 00010000:00010000:2.0:1787830324.638495:0:23814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830324.638498:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316810880 00010000:00010000:2.0:1787830324.638509:0:23814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 17 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830324.638544:0:23814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874675316811008:0@lo:104: 00000100:00100000:0.0:1787830324.638578:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787830324.638585:0:23814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830324.638610:0:22645:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787830324.638611:0:23814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25905c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830324.638624:0:22645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1787830324.638785:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+3:23814:x1874675316810880:12345-0@lo:104: 00010000:00010000:0.0:1787830324.638804:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830324.639821:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811008 00000100:00100000:2.0:1787830324.639829:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811008 00000100:00100000:3.0:1787830324.640134:0:23816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830324.640144:0:23816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f65c475-02cd-4018-98b1-85148034a57b+4:23814:x1874675316811008:12345-0@lo:104: 00010000:00010000:3.0:1787830324.640160:0:23816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830324.645637:0:23814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ed2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874675316810880:0@lo:104: 00010000:00010000:1.0:1787830324.646118:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787830324.646134:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f65c475-02cd-4018-98b1-85148034a57b+4:23814:x1874675316810880:12345-0@lo:104: Request processed in 7542us (7721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830324.646160:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787830324.646456:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830324.646473:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.646487:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9600 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830324.646494:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.646508:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830324.646518:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830324.646526:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830324.646797:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.646806:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787830324.646939:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787830324.646962:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.646993:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25906c9600/0x8eaa8d1f2dfc24cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc24d6 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.647052:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830324.647055:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830324.647056:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830324.647102:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316811136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787830324.647333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830324.647468:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811136 00000100:00100000:0.0:1787830324.647478:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811136 00010000:00010000:0.0:1787830324.647517:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 18 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830324.647694:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830324.647705:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f65c475-02cd-4018-98b1-85148034a57b+18:3638:x1874675316811136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830324.647749:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830324.647757:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 18 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.647772:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 18 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.647797:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc24d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc24cf expref: 18 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.647819:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830324.647874:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f65c475-02cd-4018-98b1-85148034a57b+17:3638:x1874675316811136:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830324.647881:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830324.647961:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316811136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830324.649145:0:23816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830324.649163:0:23816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f65c475-02cd-4018-98b1-85148034a57b+3:23814:x1874675316811008:12345-0@lo:104: Request processed in 9014us (10573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830324.649175:0:23816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787830324.649296:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830324.649326:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649337:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d0400 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830324.649342:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649353:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830324.649361:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830324.649369:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830324.649421:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649428:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830324.649458:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649465:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0400/0x8eaa8d1f2dfc23cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc23d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649488:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830324.649490:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830324.649492:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830324.649496:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316811264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830324.649553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830324.649796:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811264 00000100:00100000:0.0:1787830324.649807:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811264 00010000:00010000:0.0:1787830324.649838:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 17 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830324.649883:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830324.649893:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+17:3638:x1874675316811264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830324.649909:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830324.649915:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 17 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649928:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 17 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649950:0:23413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649960:0:23413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649978:0:23413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649986:0:23413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.649994:0:23413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.650001:0:23413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.650006:0:23413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830324.650010:0:23413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.650025:0:23413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.650036:0:23413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.650051:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830324.650103:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+17:3638:x1874675316811264:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830324.650112:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787830324.650135:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316811264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830324.650481:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1bb600/0x8eaa8d1f2dfc23d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc23cc expref: 16 pid: 22655 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830324.650496:0:23814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874675316811008:0@lo:104: 00010000:00010000:3.0:1787830324.650519:0:23814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830324.650530:0:23814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830324.650537:0:23814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830324.650544:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc252a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830324.861139:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830325.502524:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316811392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830325.502640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830325.503253:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811392 00000100:00100000:0.0:1787830325.503270:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811392 00000100:00100000:0.0:1787830325.503812:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830325.503830:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874675316811392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830325.503981:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830325.504083:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874675316811392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 257us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830325.504091:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830325.504200:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316811392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830325.504220:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787830325.504230:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316811520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830325.504268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830325.505325:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830315/real 1787830315] req@ffff9f24836ecf00 x1874675316805248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830325.505365:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f24836ecf00 x1874675316805248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830325.505377:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830315/real 1787830315] req@ffff9f24836eda40 x1874675316805120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830325.505390:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f24836eda40 x1874675316805120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830325.505412:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830325.505445:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787830325.505450:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316805248:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787830325.505457:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481a4a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830325.505462:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787830325.505465:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316805120:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787830325.505563:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811520 00000100:00100000:1.0:1787830325.505575:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811520 00000100:00100000:1.0:1787830325.505640:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830325.505652:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316811520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830325.505710:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787830325.505827:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316811520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830325.505835:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830325.505890:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316811520:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787830325.512618:0:23393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1787830325.518464:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830325.518475:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830325.518478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830325.518481:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830325.518494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830325.518499:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787830325.518503:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f2481a4a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830325.518514:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 704 00000100:00080000:3.0:1787830325.518522:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787830325.518530:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f2481a4a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830325.518560:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928ced00 x1874675316811904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830325.518581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830325.518585:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830325.518586:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830325.518591:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 704 00000100:00080000:3.0:1787830325.518593:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787830325.518597:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830325.518610:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25928cfc00 x1874675316812032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830325.518703:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316811648:0@lo:400:kworker.0 00000100:00100000:3.0:1787830325.518853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830325.518934:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830325.518942:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316811776:0@lo:400:kworker.0 00000100:00100000:3.0:1787830325.518977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830325.519007:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830325.519016:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316812160:0@lo:400:kworker.0 00000100:00100000:3.0:1787830325.519047:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830325.519084:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316811904:0@lo:8:kworker.0 00000400:00000100:3.0:1787830325.519117:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316811904 offset 0 length 520: 4 00000100:00100000:3.0:1787830325.519134:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316812032:0@lo:8:kworker.0 00000400:00000100:3.0:1787830325.519157:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874675316812032 offset 0 length 520: 4 00000100:00100000:2.0:1787830325.521950:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811648 00000100:00100000:2.0:1787830325.521970:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811648 00000100:00100000:2.0:1787830325.522207:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830325.522219:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+16:3637:x1874675316811648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830325.522339:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+16:3637:x1874675316811648:12345-0@lo:400:kworker.0 Request processed in 122us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830325.522363:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830325.522414:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316811776 00000100:00100000:2.0:1787830325.522419:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316811776 00000100:00100000:1.0:1787830325.522441:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316811648:0@lo:400:kworker.0 00000100:00100000:2.0:1787830325.522460:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812160 00000100:00100000:2.0:1787830325.522466:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812160 00000100:00100000:2.0:1787830325.522494:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830325.522503:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316811776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830325.522552:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316811776:12345-0@lo:400:kworker.0 Request processed in 52us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830325.522571:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787830325.522591:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830325.522602:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316812160:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787830325.522610:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25928cf840 x1874675316811776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830325.522629:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316811776:0@lo:400:kworker.0 00000100:00100000:2.0:1787830325.522672:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316812160:12345-0@lo:400:kworker.0 Request processed in 72us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830325.522680:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787830325.522712:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f24836eda40 x1874675316812160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830325.522748:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316812160:0@lo:400:kworker.0 00010000:00010000:3.0:1787830325.884909:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787830326.397086:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787830326.397097:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f25896b5800 from 13 10000000:01000000:1.0:1787830326.397104:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787830326.397174:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.397186:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.397213:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830326.397243:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.397343:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830326.397400:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830326.398050:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812288 00000100:00100000:3.0:1787830326.398063:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812288 00000100:00100000:3.0:1787830326.398343:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787830326.398356:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+16:22658:x1874675316812288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830326.398377:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830326.398397:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc2531 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830326.398429:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830326.398442:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830326.398464:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21d1a00, rc 0) 00000100:00100000:3.0:1787830326.398535:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316812288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830326.398542:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787830326.402298:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830326.402341:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.402357:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830326.402466:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.402534:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830326.402582:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830326.404255:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812416 00000100:00100000:3.0:1787830326.404280:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812416 00000100:00100000:3.0:1787830326.404357:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787830326.404368:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316812416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830326.404559:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316812416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830326.404773:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.404840:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.404898:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830326.404926:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787830326.404991:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812544 00000100:00100000:0.0:1787830326.404996:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812544 00000100:00100000:0.0:1787830326.405038:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787830326.405060:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830326.405180:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830326.405188:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787830326.405991:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830326.406347:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000040:00080000:3.0:1787830326.413266:0:23878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787830326.416589:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787830326.416632:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830326.416645:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830326.416657:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830326.416669:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830326.416672:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f24833f4800 from 13 10000000:01000000:0.0:1787830326.416675:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830326.416716:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830326.416771:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830326.416784:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830326.416814:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830326.416903:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830326.416944:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235240 going to sleep for 11 seconds 00000100:00100000:1.0:1787830326.417329:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812672 00000100:00100000:1.0:1787830326.417337:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812672 00000100:00100000:1.0:1787830326.417387:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787830326.417397:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+17:22658:x1874675316812672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830326.417436:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830326.417453:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc253f expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.417483:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.417496:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.417505:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2580030000, rc 0) 00000100:00100000:1.0:1787830326.417565:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830326.417572:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787830326.417621:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830326.417635:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830326.417644:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830326.417715:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.417764:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830326.417785:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830326.418953:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812800 00000100:00100000:3.0:1787830326.418965:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812800 00000100:00100000:3.0:1787830326.419004:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830326.419012:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830326.429610:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10587us (11834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830326.429628:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787830326.439022:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.439541:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830326.439628:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830326.439674:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830326.439790:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316812928 00000100:00100000:2.0:1787830326.439797:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316812928 00000100:00100000:2.0:1787830326.439846:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787830326.439855:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830326.439970:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:22658:x1874675316812928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830326.439978:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787830326.439988:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316812928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787830326.441154:0:23880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787830326.452003:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787830326.452053:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830326.452067:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830326.452080:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830326.908997:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787830327.677594:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787830327.937408:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830328.962410:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830329.980966:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787830330.429363:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787830330.620948:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316813056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830330.621050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830330.621270:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813056 00000100:00100000:0.0:1787830330.621292:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813056 00000100:00100000:3.0:1787830330.621604:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316813184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830330.621639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830330.621717:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787830330.621739:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316813312:0@lo:400:kworker.0 00000100:00100000:0.0:1787830330.621790:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813184 00000100:00100000:0.0:1787830330.621794:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813184 00000100:00100000:0.0:1787830330.621860:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787830330.621869:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316813184:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830330.621890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830330.621922:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813312 00000100:00100000:3.0:1787830330.621925:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813312 00000004:00000024:0.0:1787830330.621997:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830330.622044:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316813184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830330.622051:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787830330.622950:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830330.622957:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830330.622960:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830330.622964:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830330.622987:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830330.623053:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787830330.623056:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787830330.623058:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787830330.623076:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316813568:0@lo:400:kworker.0 00000100:00100000:0.0:1787830330.623132:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830330.623159:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830330.623165:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316813440:0@lo:400:kworker.0 00000100:00100000:0.0:1787830330.623189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830330.623241:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813440 00000100:00100000:2.0:1787830330.623247:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813440 00000100:00100000:2.0:1787830330.623267:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830330.623275:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316813056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787830330.623301:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787830330.623327:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787830330.623335:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316813440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830330.623435:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316813056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830330.623435:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316813440:12345-0@lo:400:kworker.0 Request processed in 101us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830330.623442:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787830330.623485:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830330.623494:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787830330.623494:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:3637:x1874675316813312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830330.623503:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316813696:0@lo:400:kworker.0 00000100:00100000:3.0:1787830330.623530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830330.623532:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:3637:x1874675316813312:12345-0@lo:400:kworker.0 Request processed in 41us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830330.623539:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830330.623570:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316813312:0@lo:400:kworker.0 00000100:00100000:3.0:1787830330.623589:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316813184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830330.623638:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813568 00000100:00100000:3.0:1787830330.623642:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813568 00000100:00100000:1.0:1787830330.623651:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813696 00000100:00100000:1.0:1787830330.623654:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813696 00000100:00100000:3.0:1787830330.623669:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830330.623675:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316813568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830330.623675:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787830330.623680:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316813696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830330.623711:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316813568:12345-0@lo:400:kworker.0 Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830330.623712:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316813696:12345-0@lo:400:kworker.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830330.623718:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830330.623721:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787830330.623771:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25bd29a580 x1874675316813696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830330.623783:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316813696:0@lo:400:kworker.0 00000100:00100000:0.0:1787830330.623917:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316813440:0@lo:400:kworker.0 00010000:00080000:0.0:1787830330.623926:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25bd298b40 x1874675316813568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830330.623935:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316813568:0@lo:400:kworker.0 00000100:00100000:0.0:1787830330.623948:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316813056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830330.624274:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787830331.005011:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830332.033938:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787830332.324354:0:24163:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787830332.324358:0:24163:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787830332.324361:0:24163:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787830332.324468:0:24163:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f248233c000 00000020:01000004:3.0:1787830332.324497:0:24163:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787830332.324511:0:24163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787830332.324530:0:24163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f2590483370) 00000020:00000080:3.0:1787830332.324868:0:24163:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787830332.448928:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787830332.459949:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787830332.465963:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787830332.466566:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787830332.467068:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787830332.467405:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787830332.468107:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1787830332.476289:0:24163:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787830332.476546:0:24163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787830332.476560:0:24163:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787830332.476575:0:24163:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8eaa8d1f2dfc2554 00000020:01000004:3.0:1787830332.476583:0:24163:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787830332.476606:0:24163:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787830332.476610:0:24163:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787830332.476618:0:24163:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787830332.476623:0:24163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787830332.476636:0:24163:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f25904819b8) 00000020:00000080:3.0:1787830332.476647:0:24163:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787830332.477987:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787830332.478179:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787830332.478185:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787830332.486545:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787830332.486562:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787830332.488529:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787830332.488541:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787830332.498640:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787830332.499108:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787830332.499115:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787830332.504063:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787830332.504087:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787830332.549870:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830332.550159:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787830332.550166:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787830332.551059:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787830332.551068:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787830332.573454:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787830332.573505:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787830332.587158:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787830332.587380:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787830332.587391:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787830332.592364:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787830332.592380:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787830332.721213:0:24163:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787830332.721421:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787830332.721435:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787830332.742654:0:24163:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787830332.742677:0:24163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787830332.750237:0:24163:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787830332.750281:0:24163:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787830332.750288:0:24163:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787830332.808808:0:24163:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787830332.808847:0:24163:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787830332.808852:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787830332.808854:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787830332.808855:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830332.808856:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830332.808857:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830332.808858:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830332.808860:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787830332.808861:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830332.808866:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787830332.808869:0:24163:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787830332.808871:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787830332.808872:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787830332.808873:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830332.808874:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830332.808875:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830332.808876:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830332.808877:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787830332.808877:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830332.808878:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787830332.808903:0:24163:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787830332.808923:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316813824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787830332.809676:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830332.810046:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25912da300 going to sleep for 11 seconds 00000100:00100000:3.0:1787830332.813073:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813824 00000100:00100000:3.0:1787830332.813089:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813824 00000100:00100000:3.0:1787830332.813148:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787830332.813157:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:24163:x1874675316813824:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787830332.813212:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787830332.813216:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787830332.813219:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787830332.815137:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:24163:x1874675316813824:12345-0@lo:253:mount.lustre.0 Request processed in 1974us (5457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.815152:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787830332.815198:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316813824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787830332.815215:0:24163:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787830332.815219:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787830332.815221:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787830332.815222:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830332.815224:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830332.815225:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830332.815226:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830332.815227:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830332.815230:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830332.815231:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787830332.815253:0:24163:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f248233c000 from lustre-OST0000 10000000:01000000:2.0:1787830332.815308:0:24163:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787830332.815311:0:24163:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787830332.815320:0:24163:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f25b607cd28 local copy 00010000:00010000:2.0:1787830332.815331:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830332.815460:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316813952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830332.815514:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.815555:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb5de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.815615:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316813952 00000100:00100000:1.0:1787830332.815621:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316813952 00000100:00100000:1.0:1787830332.815654:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787830332.815663:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:24163:x1874675316813952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830332.815835:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+18:24163:x1874675316813952:12345-0@lo:501:mount.lustre.0 Request processed in 173us (320us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830332.815844:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787830332.815869:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316813952:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787830332.815884:0:24163:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787830332.815910:0:24163:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787830332.815918:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.815930:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830332.815962:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f248233c000 10000000:01000000:2.0:1787830332.815966:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787830332.815971:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787830332.815973:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787830332.815977:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787830332.815980:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787830332.816001:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.816009:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.816019:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830332.816049:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830332.816090:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.816132:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb5de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.816138:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814080 00000100:00100000:1.0:1787830332.816142:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814080 00000100:00100000:1.0:1787830332.816172:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787830332.816179:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+18:24163:x1874675316814080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830332.816188:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830332.816201:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc2562 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.816227:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2562 expref: 19 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.816238:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2580030800/0x8eaa8d1f2dfc2569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2562 expref: 19 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.816247:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2580030800, rc 0) 00000100:00100000:1.0:1787830332.816285:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814080:12345-0@lo:101:mount.lustre.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.816292:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787830332.816329:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830332.816341:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2569 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.816349:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2569 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830332.819159:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787830332.819986:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830332.827007:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787830332.827093:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787830332.827107:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787830332.827118:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787830332.827130:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787830332.827143:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787830332.827155:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787830332.827166:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787830332.827196:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787830332.827208:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787830332.827218:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787830332.827227:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787830332.827248:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787830332.827252:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787830332.827373:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830332.827442:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.829300:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8ace780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.832707:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814208 00000100:00100000:1.0:1787830332.832783:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814208 00000100:00100000:1.0:1787830332.832903:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787830332.832914:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830332.833173:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814208:12345-0@lo:501:mount.lustre.0 Request processed in 261us (5731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.833181:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787830332.833282:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830332.833332:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830332.833386:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.842802:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8ace780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830332.844362:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814336 00000100:00100000:2.0:1787830332.844377:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814336 00000100:00100000:2.0:1787830332.844448:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787830332.844459:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830332.847637:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814336:12345-0@lo:503:mount.lustre.0 Request processed in 3169us (14239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.847652:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787830332.847798:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814336:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787830332.848288:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787830332.848386:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830332.848440:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830332.848498:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814464 00000100:00100000:1.0:1787830332.848505:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814464 00000100:00100000:1.0:1787830332.848553:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787830332.848562:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830332.848960:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8ace780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.848975:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814464:12345-0@lo:502:mount.lustre.0 Request processed in 414us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.848982:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830332.848991:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000040:00080000:3.0:1787830332.849192:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787830332.849227:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787830332.849241:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787830332.849254:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787830332.849266:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787830332.849280:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787830332.849293:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787830332.849306:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787830332.849318:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787830332.849329:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787830332.849341:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787830332.849353:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787830332.849376:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830332.849415:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.849441:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8ace780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830332.849762:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814592 00000100:00100000:2.0:1787830332.849769:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814592 00000100:00100000:2.0:1787830332.849810:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787830332.849818:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830332.849916:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814592:12345-0@lo:502:mount.lustre.0 Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830332.849922:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787830332.850017:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830332.850079:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1787830332.850088:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787830332.850930:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787830332.850940:0:24181:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787830332.850959:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787830332.850962:0:24181:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787830332.850969:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787830332.850989:0:24181:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f24823199b8) 00000020:00000080:0.0:1787830332.851016:0:24181:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787830332.851032:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787830332.851113:0:24181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f248233c000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787830332.851121:0:24181:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787830332.851128:0:24181:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8eaa8d1f2dfc2577 00010000:00010000:1.0:1787830332.858909:0:24181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787830332.859539:0:24181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1787830332.865530:0:24181:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787830332.870089:0:24181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787830332.870108:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830332.870115:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.870118:0:24181:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787830332.870123:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787830332.870126:0:24181:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787830332.870128:0:24181:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787830332.870129:0:24181:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787830332.870131:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787830332.870133:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.870135:0:24181:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787830332.870137:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830332.870141:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.870142:0:24181:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787830332.870145:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787830332.870147:0:24181:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787830332.870150:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830332.870152:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.870153:0:24181:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787830332.870156:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830332.870158:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.870159:0:24181:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787830332.870163:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787830332.870195:0:24181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830332.870199:0:24181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.870200:0:24181:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787830332.870204:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787830332.870333:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787830332.870372:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787830332.870394:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2569 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.870409:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c8e00/0x8eaa8d1f2dfc2562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2569 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830332.870432:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f248233c000 from 1 10000000:01000000:2.0:1787830332.870435:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830332.870488:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.870495:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.870507:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830332.870544:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830332.870617:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.870665:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb5dec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830332.870754:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814720 00000100:00100000:3.0:1787830332.870762:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814720 00000100:00100000:3.0:1787830332.870813:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787830332.870822:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316814720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830332.870834:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830332.870850:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc257e expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.870872:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.870883:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.870891:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21d0400, rc 0) 00000100:00100000:3.0:1787830332.870931:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316814720:12345-0@lo:101:mount.lustre.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.870956:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787830332.871174:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830332.871189:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.871198:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830332.875914:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787830332.876305:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830332.878039:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787830332.878089:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787830332.878102:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787830332.878133:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787830332.878145:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787830332.878165:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787830332.878177:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787830332.878187:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787830332.878198:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787830332.878208:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787830332.878219:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787830332.878239:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787830332.878244:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787830332.878349:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830332.878423:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.878484:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb5de900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.878485:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814848 00000100:00100000:1.0:1787830332.878500:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814848 00000100:00100000:1.0:1787830332.878556:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787830332.878566:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316814848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830332.878702:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316814848:12345-0@lo:501:mount.lustre.0 Request processed in 137us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.878710:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787830332.878820:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830332.878858:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830332.878898:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830332.878928:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2482679a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.878971:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316814976 00000100:00100000:1.0:1787830332.878976:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316814976 00000100:00100000:1.0:1787830332.879006:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787830332.879014:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316814976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830332.879098:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316814976:12345-0@lo:503:mount.lustre.0 Request processed in 85us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.879105:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787830332.879178:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316814976:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787830332.879568:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787830332.879656:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830332.879694:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830332.879720:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2482679a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.880113:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815104 00000100:00100000:1.0:1787830332.880118:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815104 00000100:00100000:1.0:1787830332.880157:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787830332.880165:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316815104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830332.880271:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316815104:12345-0@lo:502:mount.lustre.0 Request processed in 107us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.880279:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787830332.880476:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830332.880793:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787830332.880821:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787830332.880851:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787830332.880866:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787830332.880879:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787830332.880893:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787830332.880905:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787830332.880917:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787830332.880931:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787830332.881567:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787830332.881698:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787830332.881903:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830332.882062:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.882103:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815232 00000100:00100000:3.0:1787830332.882109:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815232 00000100:00100000:3.0:1787830332.882154:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787830332.882162:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316815232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830332.882263:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316815232:12345-0@lo:502:mount.lustre.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.882271:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787830332.882329:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8ace000 going to sleep for 11 seconds 00000100:00100000:3.0:1787830332.882352:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787830332.882402:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787830332.882409:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787830332.884408:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830332.884419:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.884421:0:24185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787830332.884429:0:24185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f248233c000 00000020:00000080:1.0:1787830332.884432:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830332.884439:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830332.884441:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.884443:0:24185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787830332.884454:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830332.884456:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830332.884458:0:24185:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787830332.884462:0:24185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f248233c000 00000020:00000080:1.0:1787830332.884464:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787830332.890102:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830332.890191:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830332.890214:0:24185:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787830332.890220:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830332.890224:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830332.890225:0:24185:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787830332.890230:0:24185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f248233c000 00000020:00000080:3.0:1787830332.890233:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830332.890289:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830332.890293:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830332.890294:0:24185:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787830332.890296:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830332.890299:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830332.890300:0:24185:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787830332.890303:0:24185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f248233c000 00000020:00000080:3.0:1787830332.890305:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830332.890349:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830332.890352:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830332.890353:0:24185:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787830332.890356:0:24185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787830332.890581:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787830332.890616:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830332.890643:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.890663:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830332.890984:0:24163:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787830332.890989:0:24163:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f248233c000 10000000:01000000:0.0:1787830332.890992:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f248233c000 10000000:01000000:0.0:1787830332.890995:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787830332.891000:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f248233c000 from 1 10000000:01000000:0.0:1787830332.891003:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787830332.891050:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.891059:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.891070:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830332.891092:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830332.891156:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830332.891298:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2482679cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830332.892266:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815360 00000100:00100000:3.0:1787830332.892277:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815360 00000100:00100000:3.0:1787830332.892332:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787830332.892341:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+20:24163:x1874675316815360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787830332.892357:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830332.892373:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21d0e00/0x8eaa8d1f2dfc2593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc258c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.892399:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21d0e00/0x8eaa8d1f2dfc2593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc258c expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.892409:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21d0e00/0x8eaa8d1f2dfc2593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc258c expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.892428:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21d0e00, rc 0) 00000100:00100000:3.0:1787830332.892481:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815360:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.892488:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787830332.892650:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830332.892668:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2593 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.892678:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2593 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830332.903881:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787830332.904334:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830332.904546:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787830332.904573:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787830332.904587:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787830332.904602:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787830332.904616:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787830332.904627:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787830332.904638:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787830332.904648:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787830332.904658:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787830332.904687:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787830332.904701:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787830332.904715:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787830332.904760:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787830332.904777:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787830332.904791:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787830332.904804:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787830332.904816:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787830332.904828:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787830332.904839:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787830332.904852:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787830332.904865:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787830332.904877:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787830332.904889:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787830332.904901:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787830332.904929:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787830332.906089:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787830332.906118:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787830332.906132:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787830332.906143:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787830332.906155:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787830332.906927:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787830332.907041:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787830332.907060:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787830332.907073:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787830332.907087:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787830332.907101:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787830332.907113:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787830332.907128:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787830332.907140:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787830332.907153:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787830332.907167:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787830332.907195:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787830332.907210:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787830332.907223:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787830332.907236:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787830332.907248:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787830332.907260:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787830332.907273:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787830332.907444:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787830332.907467:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787830332.907483:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787830332.907488:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787830332.907609:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830332.907682:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.907809:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8ace780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.912110:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815488 00000100:00100000:1.0:1787830332.912126:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815488 00000100:00100000:1.0:1787830332.912195:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787830332.912206:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830332.912394:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815488:12345-0@lo:501:mount.lustre.0 Request processed in 189us (4711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.912402:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787830332.912437:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830332.912491:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830332.912541:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.912580:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b486eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.912580:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815616 00000100:00100000:1.0:1787830332.912584:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815616 00000100:00100000:1.0:1787830332.912620:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787830332.912627:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787830332.912712:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815616:12345-0@lo:503:mount.lustre.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.912719:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787830332.912782:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787830332.913224:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787830332.913315:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830332.913357:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.913383:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b486eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.916644:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815744 00000100:00100000:1.0:1787830332.916658:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815744 00000100:00100000:1.0:1787830332.916717:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787830332.916743:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830332.916916:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815744:12345-0@lo:502:mount.lustre.0 Request processed in 189us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.916924:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787830332.920518:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830332.920840:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787830332.920874:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787830332.920888:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787830332.920901:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787830332.920915:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787830332.920927:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787830332.920952:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787830332.920966:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787830332.920998:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787830332.921014:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787830332.921039:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787830332.921058:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787830332.921071:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787830332.921082:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787830332.921094:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787830332.921107:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787830332.921120:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787830332.921132:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787830332.921145:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787830332.921159:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787830332.921172:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787830332.921185:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787830332.921197:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787830332.921209:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787830332.921236:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787830332.921248:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787830332.921272:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787830332.921286:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787830332.921300:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787830332.921312:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787830332.921324:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787830332.921337:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787830332.921349:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787830332.921359:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787830332.921371:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787830332.921385:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787830332.921398:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787830332.921410:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787830332.921422:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787830332.921444:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787830332.921471:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787830332.921486:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787830332.921500:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787830332.921513:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787830332.921525:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787830332.921536:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787830332.921548:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787830332.921560:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787830332.921610:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830332.921688:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.921763:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b486eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787830332.922205:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316815872 00000100:00100000:1.0:1787830332.922219:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316815872 00000100:00100000:1.0:1787830332.922271:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787830332.922280:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830332.922391:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316815872:12345-0@lo:502:mount.lustre.0 Request processed in 112us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830332.922398:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787830332.925206:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316815872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830332.925473:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787830332.925505:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787830332.925547:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316816000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830332.925622:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.925666:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b486eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787830332.926196:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816000 00000100:00100000:0.0:1787830332.926206:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816000 00000100:00100000:0.0:1787830332.926267:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787830332.926277:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316816000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830332.926435:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316816000:12345-0@lo:502:mount.lustre.0 Request processed in 159us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830332.926442:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787830332.926838:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316816000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830332.926910:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787830332.926923:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787830332.928177:0:24190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787830332.928195:0:24190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f25872d0000) 00000020:00000080:2.0:1787830332.928223:0:24190:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787830332.932922:0:24190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f248233c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787830332.932933:0:24190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f248233c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787830332.932936:0:24190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f248233c000 3 00010000:00080000:2.0:1787830332.932985:0:24190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2481b5a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787830332.936903:0:24190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787830332.937138:0:24190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787830332.937182:0:24190:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787830332.937194:0:24190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8eaa8d1f2dfc25a1 00000100:00080000:2.0:1787830332.937207:0:24190:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830332.937214:0:24190:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f2481b5a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830332.937251:0:24190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b7c6bc00 x1874675316816128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787830332.937317:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874675316816128:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787830332.937395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787830332.937451:0:24190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787830332.937492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.937496:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830332.937499:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.937501:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787830332.939354:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816128 00000100:00100000:3.0:1787830332.939377:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816128 00000100:00100000:3.0:1787830332.939421:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830332.939429:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874675316816128:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787830332.939457:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:3.0:1787830332.941470:0:22662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8eaa8d1f2dfc25a8 00000004:00100000:3.0:1787830332.941495:0:22662:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830332.941546:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9f25bd32d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830332.941647:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874675316816128:12345-0@lo:38:llog_process_th.0 Request processed in 2215us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.941657:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787830332.941710:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316816256:0@lo:400:kworker.0 00000100:00100000:3.0:1787830332.941764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.941841:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816256 00000100:00100000:3.0:1787830332.941848:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816256 00000100:00100000:3.0:1787830332.941885:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830332.941893:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316816256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830332.941932:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316816256:12345-0@lo:400:kworker.0 Request processed in 40us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.941937:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787830332.942055:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316816256:0@lo:400:kworker.0 00010000:00080000:3.0:1787830332.942108:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25b7c6bc00 x1874675316816128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830332.942119:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787830332.942126:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787830332.942133:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787830332.942138:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787830332.942146:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b5a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787830332.942152:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874675316816128:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787830332.943790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.943797:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830332.943799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.943802:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830332.943848:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316816512:0@lo:400:kworker.0 00000100:00100000:2.0:1787830332.943912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830332.943956:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830332.943962:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316816384:0@lo:400:kworker.0 00000100:00100000:2.0:1787830332.943987:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830332.944039:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816512 00000100:00100000:0.0:1787830332.944048:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816512 00000100:00100000:0.0:1787830332.944091:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830332.944099:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830332.944153:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316816512:12345-0@lo:400:kworker.0 Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830332.944160:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787830332.944183:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316816512:0@lo:400:kworker.0 00000020:01000004:0.0:1787830332.947768:0:24190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787830332.947791:0:24190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f2482318000) 00000020:00000080:0.0:1787830332.947817:0:24190:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787830332.947901:0:24190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f248233c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787830332.947906:0:24190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f248233c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787830332.947909:0:24190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f248233c000 3 00000100:00100000:3.0:1787830332.948630:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316816640:0@lo:400:kworker.0 00000100:00100000:3.0:1787830332.948702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.948789:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816384 00000100:00100000:3.0:1787830332.948798:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816384 00000100:00100000:2.0:1787830332.948808:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816640 00000100:00100000:2.0:1787830332.948812:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816640 00000100:00100000:2.0:1787830332.948844:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830332.948852:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316816640:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787830332.948866:0:24190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f24821f0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.130@tcp at head 00000100:00100000:2.0:1787830332.948912:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316816640:12345-0@lo:400:kworker.0 Request processed in 60us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830332.948919:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830332.948934:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787830332.948940:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316816384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830332.948987:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874675316816384:12345-0@lo:400:kworker.0 Request processed in 47us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830332.948994:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787830332.956176:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25b7c6a580 x1874675316816384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830332.956197:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874675316816384:0@lo:400:kworker.0 00010000:00080000:1.0:1787830332.956253:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25b7c6a940 x1874675316816640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830332.956263:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316816640:0@lo:400:kworker.0 00010000:00010000:0.0:1787830332.957519:0:24190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787830332.957719:0:24190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787830332.957788:0:24190:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787830332.957801:0:24190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8eaa8d1f2dfc25b6 00000100:00080000:0.0:1787830332.957811:0:24190:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830332.957818:0:24190:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f24821f0800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830332.957860:0:24190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5f9a40 x1874675316816768/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830332.957891:0:24190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787830332.958055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.958061:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830332.958064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.958066:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830332.958070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.958072:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787830332.958075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787830332.958078:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787830332.958186:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874675316816768:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787830332.958280:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787830332.959507:0:24190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1787830332.959825:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816768 00000100:00100000:3.0:1787830332.959836:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816768 00000100:00100000:3.0:1787830332.959884:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830332.959893:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874675316816768:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787830332.959927:0:22660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:3.0:1787830332.962737:0:22660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8eaa8d1f2dfc25bd 00000004:00100000:3.0:1787830332.962769:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787830332.962820:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9f25bd32c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830332.962928:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874675316816768:12345-0@lo:38:llog_process_th.0 Request processed in 3033us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.962951:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787830332.963089:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f25bb5f9a40 x1874675316816768/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830332.963102:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787830332.963111:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787830332.963119:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787830332.963124:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787830332.963126:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f24821f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787830332.963132:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874675316816768:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787830332.964079:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787830332.964137:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787830332.964162:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2593 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.964175:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1bbe00/0x8eaa8d1f2dfc258c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2593 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787830332.964239:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787830332.964241:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830332.964243:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830332.964244:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830332.964245:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830332.964246:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830332.964248:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830332.964250:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830332.964251:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787830332.964256:0:24163:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787830332.964258:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830332.964260:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787830332.964260:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830332.964261:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830332.964263:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830332.964264:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830332.964265:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830332.964266:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830332.964267:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787830332.964296:0:24163:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787830332.964318:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316816896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787830332.964380:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830332.964414:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2482679780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830332.966274:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316816896 00000100:00100000:2.0:1787830332.966290:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316816896 00000100:00100000:2.0:1787830332.966358:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787830332.966368:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:24163:x1874675316816896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787830332.966401:0:22655:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787830332.966416:0:22655:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787830332.973554:0:22655:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787830332.973574:0:22655:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787830332.973599:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787830332.973603:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787830332.973626:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.973647:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.973656:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.973664:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.973713:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.973759:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 21 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830332.973774:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fb0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316817024:0@lo:104: 00000100:00100000:0.0:1787830332.973853:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830332.973908:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830332.973915:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 21 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830332.973924:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fbc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316817152:0@lo:104: 00000100:00100000:0.0:1787830332.973961:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830332.973979:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f24826799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830332.974094:0:23816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787830332.974116:0:23816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817024 00000100:00100000:2.0:1787830332.974123:0:23816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817024 00000100:00100000:2.0:1787830332.974196:0:23816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817152 00000100:00100000:2.0:1787830332.974199:0:23816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817152 00000100:00100000:2.0:1787830332.974216:0:23816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830332.974225:0:23816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316817024:12345-0@lo:104: 00010000:00010000:2.0:1787830332.974240:0:23816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830332.974294:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830332.974302:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2481ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316817152:12345-0@lo:104: 00010000:00010000:3.0:1787830332.974311:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.974383:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830332.974390:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2481ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316817152:12345-0@lo:104: Request processed in 89us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.974397:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830332.974490:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fbc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316817152:0@lo:104: 00010000:00010000:1.0:1787830332.974514:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830332.974521:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.974529:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580031200 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:1.0:1787830332.974533:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.974542:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787830332.974549:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830332.974556:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787830332.974599:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.974606:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787830332.974636:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.974645:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f2580031200/0x8eaa8d1f2dfc2507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc250e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830332.974657:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830332.974658:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830332.974660:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830332.974663:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316817280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787830332.974694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.974761:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817280 00000100:00100000:3.0:1787830332.974766:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817280 00010000:00010000:3.0:1787830332.974783:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 22 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.974794:0:23816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787830332.974804:0:23816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316817024:12345-0@lo:104: Request processed in 581us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.974805:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830332.974810:0:23816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830332.974811:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f65c475-02cd-4018-98b1-85148034a57b+22:3638:x1874675316817280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830332.974822:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830332.974826:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 22 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.974835:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 22 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.974848:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1bb800/0x8eaa8d1f2dfc250e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2507 expref: 22 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.974853:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830332.974857:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.974859:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830332.974864:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d1800 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:2.0:1787830332.974867:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.974874:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787830332.974880:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830332.974885:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f65c475-02cd-4018-98b1-85148034a57b+21:3638:x1874675316817280:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (191us total) trans 0 rc 0/0 10000000:01000000:2.0:1787830332.974886:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787830332.974892:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787830332.974904:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.974910:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787830332.974915:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316817280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830332.974925:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.974932:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1800/0x8eaa8d1f2dfc2515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc251c expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830332.974945:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830332.974947:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830332.974948:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830332.974969:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316817408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830332.974998:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830332.975144:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817408 00000100:00100000:3.0:1787830332.975148:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817408 00010000:00010000:3.0:1787830332.975170:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 21 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830332.975193:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830332.975208:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+21:3639:x1874675316817408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787830332.975215:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830332.975220:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 21 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975228:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 21 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975240:0:23413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975248:0:23413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787830332.975261:0:23413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003570164s 00010000:00010000:3.0:1787830332.975266:0:23413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975273:0:23413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975281:0:23413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975287:0:23413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975293:0:23413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1baa00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830332.975298:0:23413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975316:0:23413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975324:0:23413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975334:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830332.975365:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+21:3639:x1874675316817408:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830332.975371:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787830332.975840:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc251c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2515 expref: 20 pid: 22655 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830332.975852:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fb0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316817024:0@lo:104: 00010000:00010000:3.0:1787830332.975871:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975880:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975887:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830332.975892:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1baa00/0x8eaa8d1f2dfc25c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830332.977884:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316817408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830332.979506:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+19:24163:x1874675316816896:12345-0@lo:253:mount.lustre.0 Request processed in 13132us (15117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830332.979521:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787830332.979605:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24163:1874675316816896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787830332.979622:0:24163:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787830332.979626:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787830332.979627:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787830332.979628:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787830332.979630:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787830332.979632:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787830332.979633:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787830332.979635:0:24163:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787830332.979637:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787830332.979639:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787830332.979654:0:24163:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787830332.984417:0:24163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787830332.988757:0:24163:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787830332.988768:0:24163:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787830332.988809:0:24163:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787830332.988862:0:24163:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787830332.988884:0:24163:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787830332.988908:0:24163:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787830332.989563:0:24163:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830332.989801:0:24163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787830333.053141:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787830334.055037:0:24243:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830334.055593:0:24243:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787830334.077392:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787830334.088413:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830334.088424:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f25896b5800 from 13 10000000:01000000:3.0:1787830334.091521:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830334.091575:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.091588:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.091601:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830334.091643:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830334.091715:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830334.091786:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2589eb1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830334.092128:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817536 00000100:00100000:2.0:1787830334.092140:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817536 00000100:00100000:2.0:1787830334.092209:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787830334.092219:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+19:22658:x1874675316817536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830334.092233:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830334.092248:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc25cb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830334.092271:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830334.092282:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830334.092291:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c9c00, rc 0) 00000100:00100000:2.0:1787830334.092344:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+20:22658:x1874675316817536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830334.092351:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787830334.093800:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830334.093825:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.093838:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830334.093930:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787830334.093987:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830334.094022:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2589eb1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830334.094155:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817664 00000100:00100000:0.0:1787830334.094162:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817664 00000100:00100000:0.0:1787830334.094208:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787830334.094217:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+20:22658:x1874675316817664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787830334.094235:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787830334.094253:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787830334.094257:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787830334.094345:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+20:22658:x1874675316817664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830334.094353:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787830334.094464:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787830334.094533:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830334.094540:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.094556:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830334.094566:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830334.094569:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f24833f4800 from 13 10000000:01000000:3.0:1787830334.094572:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830334.094595:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.094603:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.094613:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830334.094707:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830334.094832:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830334.094894:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2589eb1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830334.100007:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817792 00000100:00100000:0.0:1787830334.100020:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817792 00000100:00100000:0.0:1787830334.100071:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787830334.100082:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+20:22658:x1874675316817792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830334.100099:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830334.100117:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc25d9 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830334.100148:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830334.100161:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830334.100170:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25bd1ba800, rc 0) 00000100:00100000:0.0:1787830334.100253:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316817792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (5421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830334.100261:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787830334.104703:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830334.104772:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.104785:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830334.104861:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787830334.104934:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830334.104989:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2589eb1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830334.105412:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316817920 00000100:00100000:2.0:1787830334.105426:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316817920 00000100:00100000:2.0:1787830334.105551:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787830334.105561:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316817920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787830334.105583:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787830334.105600:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787830334.105603:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787830334.105874:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316817920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 313us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830334.105882:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787830334.105981:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316817920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787830334.106055:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830334.106063:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830334.106073:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830335.111272:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830335.740946:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316818048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830335.741025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830335.741117:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818048 00000100:00100000:3.0:1787830335.741124:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818048 00000100:00100000:3.0:1787830335.741181:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830335.741191:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316818048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830335.741225:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787830335.741274:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316818048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830335.741280:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830335.741324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316818048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830335.741668:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830335.741678:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316818176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830335.741707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830335.741813:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818176 00000100:00100000:1.0:1787830335.741817:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818176 00000100:00100000:1.0:1787830335.741856:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787830335.741862:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316818176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830335.741883:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787830335.741917:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316818176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830335.741923:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787830335.742020:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316818176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787830336.128455:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830337.150049:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787830337.923133:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787830338.172890:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830338.302961:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830338.302967:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830338.302970:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830338.302974:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830338.302991:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830338.302994:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787830338.302997:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830338.303001:0:14982:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787830338.303042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316818432:0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.303131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830338.303176:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316818944:0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.303209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830338.303240:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787830338.303245:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316818560:0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.303266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830338.303282:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316819072:0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.303303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830338.303514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316818304:0@lo:400:kworker.0 00000100:00100000:3.0:1787830338.303565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830338.303591:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316818816:0@lo:400:kworker.0 00000100:00100000:3.0:1787830338.303611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830338.303623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830338.303629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316818688:0@lo:400:kworker.0 00000100:00100000:3.0:1787830338.303647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830338.303681:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818944 00000100:00100000:3.0:1787830338.303688:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818944 00000100:00100000:3.0:1787830338.303753:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818560 00000100:00100000:3.0:1787830338.303757:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818560 00000100:00100000:3.0:1787830338.303770:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819072 00000100:00100000:3.0:1787830338.303772:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819072 00000100:00100000:3.0:1787830338.303785:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818816 00000100:00100000:3.0:1787830338.303787:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818816 00000100:00100000:3.0:1787830338.303803:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830338.303812:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.303925:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818432 00000100:00100000:0.0:1787830338.303930:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818432 00000100:00100000:0.0:1787830338.303966:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818688 00000100:00100000:0.0:1787830338.303969:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818688 00000100:00100000:0.0:1787830338.303983:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830338.303988:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316818432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830338.304110:0:22662:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787830338.304120:0:22662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787830338.304673:0:22661:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787830338.304695:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830338.304706:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316818560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830338.304831:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316818944:12345-0@lo:400:kworker.0 Request processed in 1019us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830338.304840:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787830338.304860:0:22660:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787830338.304866:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787830338.304873:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316819072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.305028:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316818432:12345-0@lo:400:kworker.0 Request processed in 1038us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830338.305036:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830338.305054:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830338.305062:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316818688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830338.305108:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316818688:12345-0@lo:400:kworker.0 Request processed in 46us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830338.305114:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787830338.305457:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316818688:0@lo:400:kworker.0 00000100:00100000:2.0:1787830338.306493:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316818304 00000100:00100000:2.0:1787830338.306506:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316818304 00000100:00100000:2.0:1787830338.306567:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787830338.306575:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:3638:x1874675316818304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830338.306642:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:3638:x1874675316818304:12345-0@lo:400:kworker.0 Request processed in 68us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830338.306649:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787830338.306694:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830338.308521:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316818560:12345-0@lo:400:kworker.0 Request processed in 3807us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830338.308537:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787830338.308574:0:22661:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787830338.308589:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830338.308603:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316818816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830338.309456:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316818816:12345-0@lo:400:kworker.0 Request processed in 854us (5837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830338.309468:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787830338.309516:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830338.309522:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830338.309714:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316819072:12345-0@lo:400:kworker.0 Request processed in 4839us (6407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830338.309735:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787830338.309964:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5fad00 x1874675316818560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830338.309994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316818560:0@lo:400:kworker.0 00010000:00080000:3.0:1787830338.310017:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f83c0 x1874675316819072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830338.310025:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316819072:0@lo:400:kworker.0 00000100:00100000:3.0:1787830338.310038:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316818432:0@lo:400:kworker.0 00010000:00080000:3.0:1787830338.310049:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f9e00 x1874675316818944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830338.310057:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316818944:0@lo:400:kworker.0 00010000:00080000:2.0:1787830338.310641:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f8000 x1874675316818816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830338.310654:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316818816:0@lo:400:kworker.0 00010000:00010000:2.0:1787830339.196921:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787830340.092022:0:24535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787830340.156858:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830325/real 1787830325] req@ffff9f25928ced00 x1874675316811904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830340.156907:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25928ced00 x1874675316811904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830340.156918:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830325/real 1787830325] req@ffff9f25928cfc00 x1874675316812032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830340.156947:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25928cfc00 x1874675316812032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830340.156966:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481a4a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830340.156989:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787830340.156994:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316811904:0@lo:8:kworker.0 00000100:00080000:1.0:1787830340.157000:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787830340.157006:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787830340.157008:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316812032:0@lo:8:kworker.0 00000100:00080000:3.0:1787830340.157169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830340.157173:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830340.157176:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830340.157179:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787830340.157206:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830340.157209:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787830340.157212:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2481a4a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830340.157217:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 714 00000100:00080000:3.0:1787830340.157222:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787830340.157228:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f2481a4a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830340.157259:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25929b4780 x1874675316819712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830340.157275:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830340.157284:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830340.157286:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830340.157290:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 714 00000100:00080000:3.0:1787830340.157293:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787830340.157296:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830340.157310:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f24836ecb40 x1874675316819840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787830340.157353:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316819456:0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.157423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.157457:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd3221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316820224:0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.157477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.157496:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830340.157502:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316819584:0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.157525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.157554:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819456 00000100:00100000:3.0:1787830340.157560:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819456 00000100:00100000:3.0:1787830340.157604:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820224 00000100:00100000:3.0:1787830340.157607:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820224 00000100:00100000:3.0:1787830340.157636:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830340.157644:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316819456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.157694:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316819456:12345-0@lo:400:kworker.0 Request processed in 50us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830340.157701:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830340.157896:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787830340.157904:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316820224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.157937:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316820224:12345-0@lo:400:kworker.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830340.157951:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787830340.157975:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787830340.157999:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25929b6580 x1874675316819456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830340.158010:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316819456:0@lo:400:kworker.0 00010000:00080000:3.0:1787830340.158018:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd3221c0 x1874675316820224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830340.158025:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd3221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316820224:0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.158047:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316819712:0@lo:8:kworker.0 00000100:00100000:3.0:1787830340.158073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.158102:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316819840:0@lo:8:kworker.0 00000100:00100000:3.0:1787830340.158122:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.158222:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316819200:0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.158268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.158286:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316819968:0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.158306:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.158325:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787830340.158331:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316819328:0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.158352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.158368:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316820096:0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.158386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.158410:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819584 00000100:00100000:0.0:1787830340.158414:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819584 00000100:00100000:0.0:1787830340.158446:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819328 00000100:00100000:0.0:1787830340.158449:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819328 00000100:00100000:0.0:1787830340.158464:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830340.158469:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316819584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.158517:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316819584:12345-0@lo:400:kworker.0 Request processed in 47us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830340.158524:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830340.158537:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830340.158542:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.158573:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316819328:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830340.158579:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830340.158601:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819712 00000100:00100000:0.0:1787830340.158605:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819712 00000100:00100000:0.0:1787830340.158617:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819840 00000100:00100000:0.0:1787830340.158619:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819840 00000100:00100000:0.0:1787830340.158628:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830340.158634:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd3221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316819712:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787830340.158659:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:0.0:1787830340.158691:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc25e7 00002000:00100000:0.0:1787830340.158706:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f24821f2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787830340.158857:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787830340.158861:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787830340.159045:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787830340.159071:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9f24821f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830340.159114:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd3221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874675316819712:12345-0@lo:8:kworker.0 Request processed in 479us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830340.159121:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787830340.159137:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830340.159141:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd321e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316819840:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787830340.159159:0:24167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787830340.159185:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd321e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316819840:12345-0@lo:8:kworker.0 Request processed in 42us (1061us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787830340.159191:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830340.159217:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819968 00000100:00100000:0.0:1787830340.159221:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819968 00000100:00100000:1.0:1787830340.159365:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820096 00000100:00100000:1.0:1787830340.159369:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820096 00000100:00100000:1.0:1787830340.159397:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830340.159404:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316819968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830340.159437:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316819968:12345-0@lo:400:kworker.0 Request processed in 35us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830340.159444:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787830340.159455:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830340.159462:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316820096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830340.159488:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316820096:12345-0@lo:400:kworker.0 Request processed in 27us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830340.159494:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787830340.159579:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316819200 00000100:00100000:3.0:1787830340.159584:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316819200 00000100:00100000:3.0:1787830340.159623:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787830340.159631:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:3637:x1874675316819200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830340.159665:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:3637:x1874675316819200:12345-0@lo:400:kworker.0 Request processed in 36us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830340.159670:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787830340.159699:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830340.160070:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316819328:0@lo:400:kworker.0 00010000:00080000:0.0:1787830340.160389:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd320780 x1874675316820096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830340.160402:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316820096:0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.160416:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316819200:0@lo:400:kworker.0 00010000:00080000:0.0:1787830340.160427:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24836eda40 x1874675316819968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830340.160435:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316819968:0@lo:400:kworker.0 00000100:00100000:0.0:1787830340.160599:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316819584:0@lo:400:kworker.0 00010000:00080000:0.0:1787830340.160639:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25929b4780 x1874675316819712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830340.160646:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830340.160654:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787830340.160662:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787830340.160668:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787830340.160671:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481a4a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787830340.161040:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787830340.161062:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316819712:0@lo:8:kworker.0 00000100:00080000:0.0:1787830340.161078:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830340.161082:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830340.161097:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316819840:0@lo:8:kworker.0 00000004:00080000:3.0:1787830340.161221:0:23402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787830340.161255:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874675316820480:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787830340.161307:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.161330:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2581377900 going to sleep for 11 seconds 00000100:00100000:3.0:1787830340.161346:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830340.161355:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316820352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830340.161381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.161414:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820480 00000100:00100000:3.0:1787830340.161419:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820480 00000100:00100000:3.0:1787830340.161459:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830340.161466:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23402:x1874675316820480:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:3.0:1787830340.161693:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787830340.162138:0:23401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787830340.162222:0:23401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 729380496418ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787830340.162229:0:23401:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787830340.166271:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820352 00000100:00100000:1.0:1787830340.166287:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820352 00000100:00100000:1.0:1787830340.166346:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830340.166356:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd3230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1874675316820352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787830340.166408:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787830340.166609:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd3230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1874675316820352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 254us (5225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830340.166618:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787830340.166677:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd320f00 x1874675316820352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830340.166704:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316820352:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1787830340.166898:0:24167:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787830340.166904:0:24167:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787830340.166948:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23402:x1874675316820480:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5481us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830340.166955:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787830340.166987:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd323c00 x1874675316820480/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787830356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830340.166997:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874675316820480:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787830340.167009:0:23402:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787830340.167043:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874675316820608:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787830340.167077:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830340.167112:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2581377900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830340.167274:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820608 00000100:00100000:1.0:1787830340.167280:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820608 00000100:00100000:1.0:1787830340.167307:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787830340.167314:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd3212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874675316820608:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787830340.167337:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787830340.167369:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd3212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874675316820608:12345-0@lo:5:osp-pre-0-1.0 Request processed in 56us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830340.167375:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787830340.167401:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd323c00 x1874675316820608/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830340.167409:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874675316820608:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787830340.167417:0:23402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787830340.167439:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874675316820736:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787830340.167459:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830340.167473:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb686c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787830340.167603:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820736 00000100:00100000:1.0:1787830340.167608:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820736 00000100:00100000:1.0:1787830340.167631:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787830340.167645:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23402:x1874675316820736:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787830340.167671:0:24167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:2.0:1787830340.167939:0:23393:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:1.0:1787830340.217708:0:24164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787830340.217844:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787830340.218430:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23402:x1874675316820736:12345-0@lo:5:osp-pre-0-1.0 Request processed in 50778us (50961us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787830340.218445:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787830340.218538:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd29bc00 x1874675316820736/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830340.218552:0:23402:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787830340.218559:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874675316820736:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787830340.218912:0:23402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1787830340.218969:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1874675316820864:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787830340.219010:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830340.219084:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb686c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787830340.219135:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820864 00000100:00100000:0.0:1787830340.219143:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820864 00000100:00100000:0.0:1787830340.219311:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830340.219321:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd299680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1874675316820864:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787830340.219423:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd299680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1874675316820864:12345-0@lo:900:osp-pre-0-1.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830340.219431:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787830340.219503:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd29bc00 x1874675316820864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787830356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830340.219515:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1874675316820864:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787830340.220984:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787830340.676010:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787830340.863345:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830340.863369:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316820992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830340.863435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.864256:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830340.864270:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316821120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830340.864311:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830340.864353:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316820992 00000100:00100000:0.0:1787830340.864360:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316820992 00000100:00100000:0.0:1787830340.864401:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821120 00000100:00100000:0.0:1787830340.864403:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821120 00000100:00100000:0.0:1787830340.864417:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830340.864424:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316820992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787830340.864457:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787830340.864497:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316820992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830340.864504:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830340.864520:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830340.864525:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316821120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830340.864569:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830340.864599:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316821120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830340.864605:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787830340.864660:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316821120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830340.866942:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316820992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787830341.249209:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787830341.249358:0:24588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830341.250410:0:24588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787830342.269521:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787830342.349834:0:24638:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787830342.350057:0:24638:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787830343.228891:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830323/real 1787830323] req@ffff9f25b66fd680 x1874675316810240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830343 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830343.228941:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25b66fd680 x1874675316810240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830343 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830343.228953:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787830323/real 1787830323] req@ffff9f25b66fd2c0 x1874675316810368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830343 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830343.228966:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f25b66fd2c0 x1874675316810368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787830343 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787830343.228988:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787830343.229029:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787830343.229034:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316810240:0@lo:8:kworker.0 00000100:00080000:3.0:1787830343.229039:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787830343.229045:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787830343.229048:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316810368:0@lo:8:kworker.0 00000100:00080000:0.0:1787830343.229159:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830343.229165:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787830343.229167:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830343.229173:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 712 00000100:00080000:0.0:1787830343.229180:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787830343.229187:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f248233b800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830343.229208:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5f9e00 x1874675316821504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787830343.229218:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316821248:0@lo:400:kworker.0 00000100:00080000:0.0:1787830343.229224:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830343.229227:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787830343.229229:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830343.229232:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 712 00000100:00080000:0.0:1787830343.229234:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787830343.229238:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830343.229246:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5fa580 x1874675316821632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830343.229278:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830343.229281:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1787830343.229293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787830343.229296:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830343.229300:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 729 00000100:00080000:0.0:1787830343.229302:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787830343.229305:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830343.229330:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5fa940 x1874675316822144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787830343.229335:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316822016:0@lo:400:kworker.0 00000100:00100000:1.0:1787830343.229361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.229373:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316821760:0@lo:400:kworker.0 00000100:00100000:1.0:1787830343.229380:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787830343.229384:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316821376:0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.229415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830343.229417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830343.229437:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874675316822272:0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.229437:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316822400:0@lo:400:kworker.0 00000100:00100000:1.0:1787830343.229457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.229463:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316821888:0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.229485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830343.229489:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821248 00000100:00100000:1.0:1787830343.229498:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821248 00000100:00100000:0.0:1787830343.229500:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316822528:0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.229520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.229549:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821376 00000100:00100000:0.0:1787830343.229552:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821376 00000100:00100000:1.0:1787830343.229572:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787830343.229576:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821888 00000100:00100000:0.0:1787830343.229578:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821888 00000100:00100000:1.0:1787830343.229579:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:3639:x1874675316821248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.229591:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787830343.229595:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316821376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830343.229774:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:3639:x1874675316821248:12345-0@lo:400:kworker.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830343.229783:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787830343.229832:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822016 00000100:00100000:1.0:1787830343.229836:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822016 00000100:00100000:1.0:1787830343.229871:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830343.229878:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316822016:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787830343.229940:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830343.233008:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316821376:12345-0@lo:400:kworker.0 Request processed in 3398us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830343.233024:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787830343.233064:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830343.233082:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316821888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.233162:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316821888:12345-0@lo:400:kworker.0 Request processed in 91us (3676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830343.233176:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787830343.233196:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821760 00000100:00100000:0.0:1787830343.233204:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821760 00000100:00100000:0.0:1787830343.233232:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822272 00000100:00100000:0.0:1787830343.233235:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822272 00000100:00100000:0.0:1787830343.233247:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822528 00000100:00100000:0.0:1787830343.233249:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822528 00000100:00100000:0.0:1787830343.233275:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787830343.233281:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316821760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.233315:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316821760:12345-0@lo:400:kworker.0 Request processed in 33us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830343.233320:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787830343.233331:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830343.233336:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd299e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874675316822272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.233362:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd299e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874675316822272:12345-0@lo:400:kworker.0 Request processed in 26us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830343.233367:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830343.233378:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787830343.233523:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874675316822528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.233557:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874675316822528:12345-0@lo:400:kworker.0 Request processed in 174us (4036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830343.233564:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787830343.233588:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830343.233625:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316821888:0@lo:400:kworker.0 00010000:00080000:0.0:1787830343.233642:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25b66fd2c0 x1874675316822528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830343.233665:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316822528:0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.233705:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316821504:0@lo:8:kworker.0 00000100:00100000:1.0:1787830343.239338:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316822016:12345-0@lo:400:kworker.0 Request processed in 9447us (9962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830343.239353:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787830343.239424:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830343.240036:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822400 00000100:00100000:2.0:1787830343.240045:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822400 00000100:00100000:2.0:1787830343.240114:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787830343.240125:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316822400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830343.240200:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316822400:12345-0@lo:400:kworker.0 Request processed in 77us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830343.240207:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787830343.240256:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830343.241082:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.241138:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316821632:0@lo:8:kworker.0 00000100:00100000:0.0:1787830343.241177:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.241206:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316822144:0@lo:8:kworker.0 00000100:00100000:0.0:1787830343.241229:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.241492:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316821376:0@lo:400:kworker.0 00010000:00080000:0.0:1787830343.241513:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24836ecb40 x1874675316822272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830343.241525:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874675316822272:0@lo:400:kworker.0 00010000:00080000:0.0:1787830343.241539:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5fb480 x1874675316822016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830343.241547:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316822016:0@lo:400:kworker.0 00000100:00100000:0.0:1787830343.241557:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316821248:0@lo:400:kworker.0 00010000:00080000:1.0:1787830343.241629:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f83c0 x1874675316821760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830343.241633:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821504 00000100:00100000:3.0:1787830343.241640:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821504 00000100:00100000:1.0:1787830343.241640:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316821760:0@lo:400:kworker.0 00010000:00080000:1.0:1787830343.241660:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24836eda40 x1874675316822400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830343.241663:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316821632 00000100:00100000:1.0:1787830343.241668:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24836eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316822400:0@lo:400:kworker.0 00000100:00100000:3.0:1787830343.241680:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316821632 00000100:00100000:1.0:1787830343.241688:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822144 00000100:00100000:1.0:1787830343.241691:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822144 00000100:00100000:3.0:1787830343.241694:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830343.241701:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316821504:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787830343.241755:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1787830343.241789:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc25ee 00002000:00100000:3.0:1787830343.241803:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f2589287800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787830343.241807:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787830343.241809:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787830343.241902:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787830343.241939:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9f2589284800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830343.241991:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874675316821504:12345-0@lo:8:kworker.0 Request processed in 290us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830343.241998:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787830343.242014:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830343.242018:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316821632:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787830343.242028:0:24167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787830343.242053:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316821632:12345-0@lo:8:kworker.0 Request processed in 34us (876us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787830343.242059:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830343.242069:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830343.242073:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316822144:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787830343.242081:0:24167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787830343.242102:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316822144:12345-0@lo:8:kworker.0 Request processed in 28us (872us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787830343.242107:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787830343.242470:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f9e00 x1874675316821504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830343.242481:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830343.242489:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787830343.242498:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787830343.242504:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787830343.242512:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f248233b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787830343.242567:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787830343.242574:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316821504:0@lo:8:kworker.0 00000100:00080000:0.0:1787830343.242589:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830343.242593:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830343.242596:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316821632:0@lo:8:kworker.0 00000100:00080000:0.0:1787830343.242603:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830343.242605:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830343.242608:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316822144:0@lo:8:kworker.0 00000004:00080000:3.0:1787830343.242993:0:22684:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787830343.243074:0:22684:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732461348424ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787830343.243080:0:22684:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787830343.245750:0:22641:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787830343.247080:0:22685:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787830343.247109:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c69a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874675316822784:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787830343.247182:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830343.247214:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787830343.247242:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822784 00000100:00100000:2.0:1787830343.247248:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822784 00000100:00100000:2.0:1787830343.247301:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787830343.247309:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22685:x1874675316822784:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787830343.247765:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830343.247777:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316822656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830343.247813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787830343.247863:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830343.248037:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822656 00000100:00100000:2.0:1787830343.248042:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822656 00000100:00100000:2.0:1787830343.248080:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787830343.248088:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd3203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874675316822656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830343.248108:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787830343.248158:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd3203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874675316822656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830343.248165:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787830343.248243:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25b7c692c0 x1874675316822656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830343.248261:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316822656:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787830343.250268:0:24170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787830343.250280:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1787830343.250286:0:24170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:3.0:1787830343.265757:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830343.265769:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.265786:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1787830343.265791:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830343.265797:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.265815:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.265837:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.265846:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.265880:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830343.266905:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830343.266914:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.266926:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1787830343.266929:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830343.266934:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.266944:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.266952:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.266958:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.266976:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830343.266987:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830343.266995:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267003:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21ffc00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.267015:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267026:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267044:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267053:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c0069d/0x8eaa8d1f2dfc25f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267075:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830343.267079:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267085:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21fe400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.267088:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267096:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267108:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267116:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc25fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.267145:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.267147:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.267149:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830343.268959:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.270436:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.270449:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.270467:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.270473:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.270480:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.270496:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.270508:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.270516:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.270559:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830343.270945:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830343.270954:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.270963:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb600 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.270968:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.270977:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.271007:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.271016:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc2603 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.271034:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.271036:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.271038:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.276887:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.276906:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.276929:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.276935:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.276943:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.276962:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.276975:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.276984:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.277014:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830343.277804:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.277811:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.277833:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.277845:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.277851:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.277861:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.277869:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.277875:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.277896:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787830343.278116:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830343.278125:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.278134:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.278145:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.278155:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.278171:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.278175:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.278183:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc260a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.278200:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.278202:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.278204:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.278479:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.278482:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.278483:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.278522:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.278542:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1baa00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.278546:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.278555:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.278568:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.278574:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2611 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.278587:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.278589:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.278590:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.278807:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.278814:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.278835:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.278838:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.278843:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.278853:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.278862:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.278875:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.278892:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.279106:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.279112:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.279119:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bac00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.279123:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.279131:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.279155:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.279163:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2618 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.279178:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.279179:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.279181:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.279339:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.279345:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.279354:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.279357:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.279361:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.279370:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.279378:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.279385:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.279563:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830343.280572:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.280584:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.280605:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.280609:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.280615:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.280627:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.280635:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.280644:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.287913:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830343.287934:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.287950:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.287956:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.287969:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.287994:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.288002:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc261f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.288036:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.288040:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.288047:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1ba000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.288051:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.288059:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.288070:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.288078:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.288079:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.288081:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.288243:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787830343.288251:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc2626 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787830343.292129:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.292143:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.292161:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.292167:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.292174:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.292201:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.292213:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.292221:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.293706:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830343.293746:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.293761:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.293767:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.293777:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.293810:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.293829:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.293831:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.293833:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.300263:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787830343.300278:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9bd11bb/0x8eaa8d1f2dfc262d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.301128:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.302089:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.302101:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.302121:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.302127:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.302133:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.302148:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.302172:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.302179:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.302209:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830343.302452:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830343.302471:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.302480:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.302485:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.302494:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.302517:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.302525:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d1022e/0x8eaa8d1f2dfc2634 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.302552:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.302554:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.302556:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.302657:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.302971:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.302978:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.302989:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.302993:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.302997:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303007:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303015:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303023:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303057:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.303227:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.303234:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.303242:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1ba000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.303245:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.303263:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.303275:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.303282:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc401c0/0x8eaa8d1f2dfc263b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.303298:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.303299:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.303301:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.303531:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.303701:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303712:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.303715:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.303720:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303763:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303772:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303780:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.303800:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.303985:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.303991:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.303998:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bac00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.304002:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.304009:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.304020:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.304038:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641e927a/0x8eaa8d1f2dfc2642 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.304053:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.304055:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.304057:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.304910:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.304920:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.304932:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.304942:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.304947:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.304959:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.304966:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.304973:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.304996:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.305331:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.305338:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.305347:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.305350:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.305359:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.305372:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.305380:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a54a95/0x8eaa8d1f2dfc2649 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.305399:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.305400:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.305402:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.305509:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.305515:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.305524:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.305527:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.305531:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306000:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306009:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306024:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306047:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830343.306403:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.306409:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306419:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.306422:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.306427:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306442:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306450:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306457:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.306637:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787830343.306793:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787830343.306803:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306812:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1ba400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:2.0:1787830343.306817:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306838:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306857:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306865:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b73f31/0x8eaa8d1f2dfc2650 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306887:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787830343.306890:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306908:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1baa00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:2.0:1787830343.306911:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306919:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306929:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306936:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036931c03/0x8eaa8d1f2dfc2657 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.306950:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830343.306952:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830343.306954:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.307788:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.307800:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.307830:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.307835:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.307841:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.307853:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.307862:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.307869:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.307885:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.308162:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.308169:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.308177:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1bb600 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.308181:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.308190:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.308205:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.308212:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e525837/0x8eaa8d1f2dfc265e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.308232:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.308234:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.308237:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.308244:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.308369:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.308375:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.308384:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.308388:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.308392:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.308401:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.308420:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.308427:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.308484:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830343.310259:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.310272:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.310287:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.310291:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.310296:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.310308:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.310316:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.310323:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310403:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830343.310412:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310420:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.310424:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310444:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310639:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310649:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005142cd52/0x8eaa8d1f2dfc2665 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310667:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.310670:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310676:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.310679:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310686:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310696:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.310704:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.310706:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.310714:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.311683:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787830343.311693:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc266c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.311886:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.312694:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.312703:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.312717:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.312752:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.312758:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.312772:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.312780:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.312786:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.312802:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.313167:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.313174:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313183:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.313186:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313195:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313212:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313220:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9dd2743/0x8eaa8d1f2dfc2673 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313240:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.313242:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.313244:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830343.313528:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830343.313643:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313655:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1787830343.313658:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830343.313672:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313682:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313690:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313697:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.313791:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787830343.314199:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830343.314205:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314215:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1787830343.314219:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830343.314223:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314234:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314242:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314260:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314283:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830343.314317:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830343.314325:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314335:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580030a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.314338:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314348:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314363:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314370:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc267a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314385:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830343.314389:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314395:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580031200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.314398:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314404:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314424:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314429:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc2681 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.314441:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.314443:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.314445:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.314686:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830343.314902:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830343.314909:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314919:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1787830343.314923:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830343.314927:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314938:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314947:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.314955:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.315015:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830343.316287:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830343.316313:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.316326:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830343.316331:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.316340:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.316358:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.316377:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc2688 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.316403:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.316405:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.316407:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.320203:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.320231:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.320255:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.320261:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.320269:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.320294:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.320305:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.320314:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.320339:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830343.320485:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830343.320493:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.320503:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830343.320509:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.320519:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.320537:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.320544:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010d0162e/0x8eaa8d1f2dfc268f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830343.320576:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.320578:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830343.320580:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.324968:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.324987:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.325009:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.325024:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.325032:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.325048:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.325058:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.325079:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.325108:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.325131:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.325139:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.325153:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.325158:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.325168:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.325187:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.325194:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee844a6/0x8eaa8d1f2dfc2696 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.325215:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.325217:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.325219:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.326259:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.326269:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.326282:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.326285:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.326291:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.326302:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.326310:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.326318:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.326342:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.326374:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.326381:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.326389:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.326393:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.326401:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.326422:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.326429:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c36e226/0x8eaa8d1f2dfc269d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.326444:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.326446:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.326448:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830343.327489:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830343.327511:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.327529:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=732s v=(0 0) 00010000:00010000:0.0:1787830343.327532:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830343.327537:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.327549:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.327558:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.327565:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.327587:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.327839:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.327847:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.327856:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2600 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.327860:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.327869:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.327883:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.327890:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ccc6172/0x8eaa8d1f2dfc26a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.327921:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.327924:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.327925:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830343.330959:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830343.330974:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.330993:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1787830343.330999:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830343.331005:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331021:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331041:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331048:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331066:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787830343.331438:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830343.331445:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331452:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1787830343.331455:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830343.331764:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.331774:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.331783:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.331788:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331793:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.331798:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331807:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.331814:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.331817:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.331836:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c04b078/0x8eaa8d1f2dfc26ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.331859:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.331861:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.331863:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830343.332212:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.332250:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.332362:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.332368:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.332386:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.332389:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.332396:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.332408:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.332416:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc26b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.332435:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.332437:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.332439:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830343.333035:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830343.333044:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333056:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1787830343.333060:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830343.333066:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333078:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333086:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333094:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333114:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.333140:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.333146:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333153:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.333157:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333165:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333187:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333194:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e5d3af/0x8eaa8d1f2dfc26b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333211:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.333213:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.333215:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830343.333841:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830343.333849:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333858:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1787830343.333870:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830343.333876:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333886:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333894:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333901:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.333921:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830343.333962:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830343.333968:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333976:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830343.333979:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.333988:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.334001:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.334008:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dea66a47/0x8eaa8d1f2dfc26c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830343.334033:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.334035:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830343.334037:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830343.334853:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830343.334863:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.334874:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1787830343.334878:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830343.334884:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.334896:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.334905:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.334917:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.334941:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830343.335211:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830343.335219:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.335229:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830343.335233:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.335242:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.335266:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.335273:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc26c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.335293:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.335296:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.335297:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787830343.335620:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830343.335627:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.335637:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=732s v=(0 0) 00010000:00010000:2.0:1787830343.335640:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830343.335645:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.335654:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.335663:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.335669:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830343.335694:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830343.336084:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830343.336090:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.336099:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830343.336104:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.336113:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.336128:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.336136:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc26ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830343.336171:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.336174:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830343.336176:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787830343.336349:0:24170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787830343.336609:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c69a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874675316822784:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787830343.336625:0:22685:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787830343.336670:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874675316822912:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787830343.337715:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22685:x1874675316822784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90399us (90525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830343.337761:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830343.339843:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830343.339892:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b87dc180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830343.342157:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316822912 00000100:00100000:1.0:1787830343.342175:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316822912 00000100:00100000:1.0:1787830343.342251:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787830343.342263:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22685:x1874675316822912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787830343.342321:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1787830343.351700:0:24164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787830343.351828:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787830343.362996:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22685:x1874675316822912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20728us (23153us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787830343.363011:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787830343.363167:0:22685:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787830343.363180:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874675316822912:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787830343.363199:0:22685:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1787830344.318925:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830345.342795:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830345.470049:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316823040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830345.470137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830345.470210:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823040 00000100:00100000:3.0:1787830345.470220:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823040 00000100:00100000:3.0:1787830345.470283:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787830345.470292:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd322580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316823040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830345.470333:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787830345.470380:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd322580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316823040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830345.470386:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787830345.470407:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830345.470446:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316823040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830345.981074:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830345.981100:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316823168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830345.981314:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830345.981326:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316823296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830345.981363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830345.981422:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823168 00000100:00100000:2.0:1787830345.981432:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823168 00000100:00100000:2.0:1787830345.981509:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787830345.981519:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316823168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787830345.981555:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787830345.981612:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316823168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830345.981620:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787830345.981661:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316823168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830345.981754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830345.981852:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823296 00000100:00100000:0.0:1787830345.981857:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823296 00000100:00100000:0.0:1787830345.981900:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787830345.981908:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd299a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316823296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830345.981928:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830345.981972:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd299a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316823296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830345.981998:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787830345.982004:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316823296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787830346.365878:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787830347.134355:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830347.409522:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830348.414083:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830348.541128:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830348.541134:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787830348.541138:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830348.541146:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 732 00000100:00080000:0.0:1787830348.541150:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787830348.541158:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830348.541196:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5f9e00 x1874675316823808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830348.541231:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830348.541233:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787830348.541235:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830348.541239:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 732 00000100:00080000:0.0:1787830348.541241:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787830348.541245:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830348.541254:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5f8000 x1874675316824320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830348.541298:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316823424:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541426:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316824064:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541488:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316824704:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541515:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541540:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787830348.541546:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316823552:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541585:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316824192:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541637:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316823680:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541676:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316824448:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541713:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787830348.541747:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316823936:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541787:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316824576:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.541805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541832:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316823808:0@lo:8:kworker.0 00000100:00100000:0.0:1787830348.541853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541867:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316824320:0@lo:8:kworker.0 00000100:00100000:0.0:1787830348.541886:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.541911:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823424 00000100:00100000:0.0:1787830348.541918:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823424 00000100:00100000:0.0:1787830348.541967:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787830348.541976:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:3639:x1874675316823424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542021:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:3639:x1874675316823424:12345-0@lo:400:kworker.0 Request processed in 46us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542033:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787830348.542065:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824064 00000100:00100000:0.0:1787830348.542069:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824064 00000100:00100000:0.0:1787830348.542089:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823552 00000100:00100000:0.0:1787830348.542092:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823552 00000100:00100000:0.0:1787830348.542104:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830348.542109:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316824064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542141:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316824064:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542147:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787830348.542157:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787830348.542163:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316823552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542188:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316823552:12345-0@lo:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542194:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787830348.542209:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824704 00000100:00100000:0.0:1787830348.542214:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824704 00000100:00100000:0.0:1787830348.542243:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824448 00000100:00100000:0.0:1787830348.542245:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824448 00000100:00100000:0.0:1787830348.542254:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823936 00000100:00100000:0.0:1787830348.542256:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823936 00000100:00100000:0.0:1787830348.542266:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824576 00000100:00100000:0.0:1787830348.542268:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824576 00000100:00100000:0.0:1787830348.542284:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830348.542289:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316824704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542319:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316824704:12345-0@lo:400:kworker.0 Request processed in 30us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542325:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830348.542343:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830348.542349:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316824448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542382:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316824448:12345-0@lo:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542388:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830348.542397:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830348.542403:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316823936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542428:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316823936:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542433:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830348.542444:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830348.542450:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316824576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542474:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316824576:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542480:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787830348.542503:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824192 00000100:00100000:0.0:1787830348.542507:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824192 00000100:00100000:0.0:1787830348.542527:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823680 00000100:00100000:0.0:1787830348.542530:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823680 00000100:00100000:0.0:1787830348.542542:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316823808 00000100:00100000:0.0:1787830348.542545:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316823808 00000100:00100000:0.0:1787830348.542553:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824320 00000100:00100000:0.0:1787830348.542555:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824320 00000100:00100000:0.0:1787830348.542562:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830348.542569:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316824192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542600:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316824192:12345-0@lo:400:kworker.0 Request processed in 32us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542615:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787830348.542626:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830348.542632:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316823680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.542661:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316823680:12345-0@lo:400:kworker.0 Request processed in 29us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.542666:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787830348.542677:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830348.542681:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316823808:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787830348.542699:0:24167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787830348.542780:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316823808:12345-0@lo:8:kworker.0 Request processed in 96us (925us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787830348.542786:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830348.542797:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830348.542801:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316824320:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787830348.542811:0:24167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787830348.542832:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316824320:12345-0@lo:8:kworker.0 Request processed in 29us (945us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787830348.542837:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787830348.542910:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787830348.542914:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787830348.542916:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787830348.542926:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316824832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830348.542955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830348.542993:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824832 00000100:00100000:0.0:1787830348.542997:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824832 00000100:00100000:0.0:1787830348.543028:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830348.543033:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316824832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830348.543055:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830348.543093:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316824832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830348.543099:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830348.543142:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316824832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787830348.543173:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830348.543179:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830348.543182:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316823808:0@lo:8:kworker.0 00000100:00080000:0.0:1787830348.543191:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830348.543194:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787830348.543197:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316824320:0@lo:8:kworker.0 00010000:00080000:0.0:1787830348.543229:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f83c0 x1874675316823936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830348.543240:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316823936:0@lo:400:kworker.0 00010000:00080000:0.0:1787830348.543252:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24837a9a40 x1874675316824576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830348.543260:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316824576:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.543269:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316823680:0@lo:400:kworker.0 00010000:00080000:0.0:1787830348.543278:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5fad00 x1874675316824448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830348.543285:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316824448:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.543324:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316823552:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.543334:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316824192:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.543344:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b66fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316823424:0@lo:400:kworker.0 00000100:00100000:0.0:1787830348.543354:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316824064:0@lo:400:kworker.0 00010000:00080000:0.0:1787830348.543364:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f24837ab0c0 x1874675316824704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830348.543372:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316824704:0@lo:400:kworker.0 00010000:00010000:2.0:1787830349.437158:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787830349.570611:0:24984:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787830349.570616:0:24984:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787830349.570617:0:24984:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787830349.571467:0:24984:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f258971f800 00000020:01000004:3.0:1787830349.571489:0:24984:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787830349.571505:0:24984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787830349.571521:0:24984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f2590480000) 00000020:00000080:3.0:1787830349.571541:0:24984:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787830349.635080:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787830349.638835:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787830349.639467:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787830349.639810:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787830349.640083:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787830349.640427:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787830349.640604:0:24984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1787830349.642860:0:24984:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787830349.643320:0:24984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787830349.643337:0:24984:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787830349.643352:0:24984:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8eaa8d1f2dfc26dc 00000020:01000004:3.0:1787830349.643361:0:24984:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787830349.643494:0:24984:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787830349.643498:0:24984:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787830349.643506:0:24984:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787830349.643535:0:24984:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787830349.643539:0:24984:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787830349.658039:0:24984:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787830349.658088:0:24984:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787830349.658094:0:24984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787830349.658096:0:24984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787830349.658097:0:24984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830349.658099:0:24984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830349.658100:0:24984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830349.658101:0:24984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830349.658103:0:24984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830349.658104:0:24984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830349.658106:0:24984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830349.658109:0:24984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787830349.658112:0:24984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787830349.658113:0:24984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787830349.658114:0:24984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787830349.658115:0:24984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787830349.658116:0:24984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787830349.658117:0:24984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787830349.658118:0:24984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787830349.658119:0:24984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787830349.658120:0:24984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787830349.658159:0:24984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787830349.658182:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316824960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787830349.658281:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.658321:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b86b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.658338:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316824960 00000100:00100000:1.0:1787830349.658347:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316824960 00000100:00100000:1.0:1787830349.658406:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787830349.658416:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:24984:x1874675316824960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787830349.658456:0:22656:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787830349.658460:0:22656:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787830349.658463:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787830349.658891:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:24984:x1874675316824960:12345-0@lo:253:mount.lustre.0 Request processed in 476us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.658900:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787830349.659409:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316824960:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787830349.659423:0:24984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787830349.659426:0:24984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787830349.659428:0:24984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830349.659429:0:24984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830349.659431:0:24984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830349.659432:0:24984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830349.659433:0:24984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830349.659434:0:24984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830349.659436:0:24984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830349.659437:0:24984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787830349.659459:0:24984:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f258971f800 from lustre-OST0001 10000000:01000000:3.0:1787830349.659502:0:24984:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787830349.659505:0:24984:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787830349.659514:0:24984:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f25b607cd28 local copy 00010000:00010000:3.0:1787830349.659526:0:24984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830349.659629:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830349.659667:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830349.659824:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.661367:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825088 00000100:00100000:1.0:1787830349.661383:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825088 00000100:00100000:1.0:1787830349.661455:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787830349.661465:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24984:x1874675316825088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830349.663011:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24984:x1874675316825088:12345-0@lo:501:mount.lustre.0 Request processed in 231us (2027us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830349.663030:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787830349.670207:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825088:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787830349.670259:0:24984:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787830349.670326:0:24984:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787830349.670336:0:24984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.670348:0:24984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba600/0x8eaa8d1f2dfc230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2316 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830349.670388:0:24984:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f258971f800 10000000:01000000:2.0:1787830349.670395:0:24984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787830349.670400:0:24984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787830349.670403:0:24984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787830349.670408:0:24984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787830349.670411:0:24984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787830349.670450:0:24984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.670477:0:24984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.670489:0:24984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830349.670514:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830349.670582:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.670616:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.671851:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825216 00000100:00100000:1.0:1787830349.671864:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825216 00000100:00100000:1.0:1787830349.671935:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787830349.671946:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:24984:x1874675316825216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830349.671962:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830349.671980:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25814b2c00/0x8eaa8d1f2dfc26ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc26e3 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830349.672008:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25814b2c00/0x8eaa8d1f2dfc26ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc26e3 expref: 22 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830349.672019:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25814b2c00/0x8eaa8d1f2dfc26ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc26e3 expref: 22 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830349.672029:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25814b2c00, rc 0) 00000100:00100000:1.0:1787830349.672100:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825216:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.672107:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787830349.672352:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830349.672372:0:24984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc26ea expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.672381:0:24984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc26ea expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830349.675355:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1787830349.676673:0:24984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830349.681071:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787830349.681134:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787830349.681149:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787830349.681161:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787830349.681172:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787830349.681316:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787830349.681336:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787830349.681349:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787830349.681363:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1787830349.681402:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1787830349.681417:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1787830349.681902:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830349.681979:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.682030:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787830349.682059:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825344 00000100:00100000:0.0:1787830349.682067:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825344 00000100:00100000:1.0:1787830349.682184:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787830349.682197:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787830349.682368:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825344:12345-0@lo:501:mount.lustre.0 Request processed in 174us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.682386:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787830349.682469:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830349.682502:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830349.682543:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.682570:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.682624:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825472 00000100:00100000:3.0:1787830349.682641:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825472 00000100:00100000:3.0:1787830349.682675:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787830349.682682:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830349.683538:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825472:12345-0@lo:503:mount.lustre.0 Request processed in 853us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.683548:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787830349.686835:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787830349.687865:0:24984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787830349.687966:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830349.688067:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.688120:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.688761:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825600 00000100:00100000:1.0:1787830349.688773:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825600 00000100:00100000:1.0:1787830349.688843:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787830349.688852:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830349.689635:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825600:12345-0@lo:502:mount.lustre.0 Request processed in 780us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.689645:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787830349.689780:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787830349.690159:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787830349.690190:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787830349.690206:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787830349.690230:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787830349.690242:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787830349.690253:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787830349.690272:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787830349.690284:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787830349.690294:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787830349.690328:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830349.690373:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.690413:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a274ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.690482:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825728 00000100:00100000:3.0:1787830349.690490:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825728 00000100:00100000:3.0:1787830349.690536:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787830349.690545:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830349.690650:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825728:12345-0@lo:502:mount.lustre.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.690657:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787830349.690768:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787830349.691630:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787830349.691643:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787830349.693895:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787830349.693907:0:24988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787830349.693915:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.693917:0:24988:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787830349.693923:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787830349.693948:0:24988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f2483334d28) 00000020:00000080:3.0:1787830349.693975:0:24988:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787830349.693982:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787830349.694071:0:24988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f258971f800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787830349.694086:0:24988:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787830349.694093:0:24988:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8eaa8d1f2dfc26f8 00010000:00010000:0.0:1787830349.708636:0:24988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787830349.710544:0:24988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1787830349.714254:0:24988:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787830349.717766:0:24988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787830349.717781:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830349.717788:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830349.717790:0:24988:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787830349.717794:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830349.717798:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830349.717800:0:24988:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787830349.717802:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787830349.717804:0:24988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787830349.717807:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830349.717809:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830349.717810:0:24988:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787830349.717813:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787830349.717815:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830349.717816:0:24988:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787830349.717819:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787830349.717855:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787830349.717858:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787830349.717860:0:24988:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787830349.717871:0:24988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1787830349.718010:0:24984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787830349.718045:0:24984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787830349.718067:0:24984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc26ea expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.718078:0:24984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c8400/0x8eaa8d1f2dfc26e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc26ea expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830349.718087:0:24984:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f258971f800 from 1 10000000:01000000:2.0:1787830349.718090:0:24984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830349.718126:0:24984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.718147:0:24984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.718159:0:24984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830349.718184:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787830349.719403:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.719459:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.720162:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825856 00000100:00100000:1.0:1787830349.720173:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825856 00000100:00100000:1.0:1787830349.720227:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787830349.720236:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:24984:x1874675316825856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787830349.720252:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830349.720270:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc26ff expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830349.720298:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830349.720309:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830349.720318:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25814b3e00, rc 0) 00000100:00100000:1.0:1787830349.720374:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316825856:12345-0@lo:101:mount.lustre.0 Request processed in 139us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.720380:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787830349.721246:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830349.721280:0:24984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.721290:0:24984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787830349.729955:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787830349.730306:0:24984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787830349.730653:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787830349.730681:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787830349.730706:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787830349.730762:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787830349.730783:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787830349.730799:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787830349.730813:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787830349.730832:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787830349.730847:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787830349.730859:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787830349.730895:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787830349.730916:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787830349.730922:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787830349.731022:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830349.731103:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.731153:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.731414:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316825984 00000100:00100000:3.0:1787830349.731421:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316825984 00000100:00100000:3.0:1787830349.731496:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787830349.731506:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316825984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787830349.731623:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316825984:12345-0@lo:501:mount.lustre.0 Request processed in 120us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.731632:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787830349.731805:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316825984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830349.731841:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787830349.731883:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.731910:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.732056:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826112 00000100:00100000:3.0:1787830349.732062:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826112 00000100:00100000:3.0:1787830349.732098:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787830349.732105:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830349.732280:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826112:12345-0@lo:503:mount.lustre.0 Request processed in 175us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.732288:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787830349.732371:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826112:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787830349.732890:0:24984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787830349.732955:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830349.733006:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.733037:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.734752:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826240 00000100:00100000:3.0:1787830349.734764:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826240 00000100:00100000:3.0:1787830349.734821:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787830349.734831:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787830349.734991:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826240:12345-0@lo:502:mount.lustre.0 Request processed in 161us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.734999:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787830349.735515:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830349.735792:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787830349.735828:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787830349.735842:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787830349.735857:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787830349.735870:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787830349.735882:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787830349.735894:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787830349.735908:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787830349.735921:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787830349.735931:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787830349.735944:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787830349.735989:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830349.736046:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.736087:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826368 00000100:00100000:2.0:1787830349.736091:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826368 00000100:00100000:2.0:1787830349.736139:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787830349.736147:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830349.737683:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826368:12345-0@lo:502:mount.lustre.0 Request processed in 1530us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830349.737706:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787830349.737792:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25892d6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787830349.737815:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830349.737900:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787830349.737914:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787830349.739080:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830349.739092:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739095:0:24992:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787830349.739104:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f258971f800 00000020:00000080:3.0:1787830349.739107:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830349.739124:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830349.739127:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739129:0:24992:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787830349.739132:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830349.739134:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739136:0:24992:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787830349.739140:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f258971f800 00000020:00000080:3.0:1787830349.739142:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830349.739209:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830349.739213:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739214:0:24992:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787830349.739217:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830349.739220:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739221:0:24992:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787830349.739225:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f258971f800 00000020:00000080:3.0:1787830349.739227:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830349.739246:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830349.739249:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739251:0:24992:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787830349.739253:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787830349.739255:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739256:0:24992:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787830349.739260:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f258971f800 00000020:00000080:3.0:1787830349.739262:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787830349.739285:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787830349.739288:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787830349.739290:0:24992:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787830349.739292:0:24992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787830349.739683:0:24984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787830349.739751:0:24984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830349.739770:0:24984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.739782:0:24984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830349.739838:0:24984:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787830349.739841:0:24984:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f258971f800 10000000:01000000:0.0:1787830349.739853:0:24984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f258971f800 10000000:01000000:0.0:1787830349.739857:0:24984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787830349.739863:0:24984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f258971f800 from 1 10000000:01000000:0.0:1787830349.739866:0:24984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787830349.739902:0:24984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.739911:0:24984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.739923:0:24984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830349.739947:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787830349.740011:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.740042:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a274ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787830349.740147:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826496 00000100:00100000:2.0:1787830349.740153:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826496 00000100:00100000:2.0:1787830349.740198:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787830349.740206:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:24984:x1874675316826496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787830349.740217:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830349.740229:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc2714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc270d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.740251:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc2714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc270d expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.740263:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c9a00/0x8eaa8d1f2dfc2714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc270d expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.740272:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c9a00, rc 0) 00000100:00100000:2.0:1787830349.740325:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826496:12345-0@lo:101:mount.lustre.0 Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830349.740332:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787830349.741656:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787830349.741681:0:24984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2714 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.741704:0:24984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2714 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787830349.744866:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787830349.745155:0:24984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787830349.745337:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787830349.745361:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787830349.745374:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787830349.745812:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787830349.745826:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787830349.745852:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787830349.745866:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787830349.745894:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787830349.745912:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787830349.745927:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787830349.745943:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787830349.745958:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787830349.745974:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787830349.745988:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787830349.746003:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787830349.746018:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787830349.746030:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787830349.746045:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787830349.746060:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787830349.746076:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787830349.746092:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787830349.746107:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787830349.746122:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787830349.746151:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787830349.746167:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787830349.746181:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787830349.746193:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787830349.746205:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787830349.746218:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787830349.746234:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787830349.746249:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787830349.746264:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787830349.746279:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787830349.746293:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787830349.746307:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787830349.746322:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787830349.746337:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787830349.746352:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787830349.751553:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787830349.751641:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787830349.751660:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787830349.751674:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787830349.751687:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787830349.751713:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787830349.751743:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787830349.751757:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787830349.751772:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787830349.751784:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787830349.751970:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787830349.751992:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787830349.752009:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787830349.752015:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787830349.752131:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830349.752206:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.752257:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830349.754291:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826624 00000100:00100000:2.0:1787830349.754308:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826624 00000100:00100000:2.0:1787830349.754400:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787830349.754414:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787830349.754632:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826624:12345-0@lo:501:mount.lustre.0 Request processed in 222us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830349.754641:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787830349.766811:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787830349.766881:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787830349.766970:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.767022:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b486ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.767666:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826752 00000100:00100000:3.0:1787830349.767674:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826752 00000100:00100000:3.0:1787830349.768336:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787830349.768348:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787830349.768512:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826752:12345-0@lo:503:mount.lustre.0 Request processed in 166us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.768529:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787830349.769527:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787830349.770043:0:24984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787830349.770138:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd2992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830349.770217:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830349.772450:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a01c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830349.773344:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316826880 00000100:00100000:0.0:1787830349.773356:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316826880 00000100:00100000:0.0:1787830349.775265:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787830349.775283:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787830349.775595:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316826880:12345-0@lo:502:mount.lustre.0 Request processed in 318us (5378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.775603:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787830349.778623:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd2992c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316826880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830349.778958:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787830349.778993:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787830349.779009:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787830349.779024:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787830349.779037:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787830349.779050:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787830349.779063:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787830349.779076:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787830349.779089:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787830349.779103:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787830349.779116:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787830349.779128:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787830349.779140:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787830349.779152:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787830349.779164:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787830349.779178:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787830349.779191:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787830349.779203:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787830349.779229:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787830349.779242:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787830349.779272:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787830349.779287:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787830349.779300:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787830349.779313:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787830349.779326:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787830349.779339:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787830349.779350:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787830349.779362:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787830349.779806:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787830349.779839:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787830349.779853:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787830349.779873:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787830349.779888:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787830349.779900:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787830349.779914:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787830349.779927:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787830349.779957:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787830349.779974:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787830349.779987:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787830349.779998:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787830349.780009:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787830349.780021:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787830349.780032:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787830349.780043:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787830349.780055:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787830349.780066:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787830349.780077:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787830349.780089:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787830349.780144:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316827008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830349.780651:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.780721:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a9bc0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.780814:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827008 00000100:00100000:1.0:1787830349.780822:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827008 00000100:00100000:1.0:1787830349.780883:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787830349.780892:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316827008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830349.781025:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316827008:12345-0@lo:502:mount.lustre.0 Request processed in 134us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.781033:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787830349.782715:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316827008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830349.783002:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787830349.783029:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787830349.783072:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316827136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787830349.783141:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.783183:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.783264:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827136 00000100:00100000:1.0:1787830349.783271:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827136 00000100:00100000:1.0:1787830349.783325:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787830349.783335:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316827136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787830349.783460:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316827136:12345-0@lo:502:mount.lustre.0 Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.783467:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787830349.783606:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316827136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787830349.783648:0:24984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787830349.783657:0:24984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787830349.786902:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787830349.786922:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f25bc77b370) 00000020:00000080:1.0:1787830349.786952:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787830349.787052:0:24997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f258971f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787830349.787056:0:24997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f258971f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787830349.787059:0:24997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f258971f800 3 00010000:00080000:1.0:1787830349.787095:0:24997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2483561000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787830349.793567:0:24997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787830349.793828:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787830349.793877:0:24997:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787830349.793892:0:24997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8eaa8d1f2dfc2722 00000100:00080000:2.0:1787830349.793904:0:24997:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787830349.793911:0:24997:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2483561000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787830349.793951:0:24997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25b7c6a940 x1874675316827264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787830349.793982:0:24997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787830349.797444:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316827264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787830349.797528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830349.798489:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827264 00000100:00100000:1.0:1787830349.798502:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827264 00000100:00100000:1.0:1787830349.798549:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787830349.798557:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874675316827264:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787830349.798593:0:24451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:1.0:1787830349.798633:0:24451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8eaa8d1f2dfc2729 00000004:00100000:1.0:1787830349.798652:0:24451:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787830349.798701:0:24451:0:(import.c:65:import_set_state_nolock()) ffff9f2483567000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830349.798794:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874675316827264:12345-0@lo:38:llog_process_th.0 Request processed in 236us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.798814:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787830349.801059:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830349.801069:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830349.801072:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830349.801083:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 737 00000100:00080000:3.0:1787830349.801089:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787830349.801097:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830349.801122:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bd323c00 x1874675316827648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787830349.801156:0:14982:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787830349.801159:0:14982:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787830349.801161:0:14982:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787830349.801165:0:14982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 737 00000100:00080000:3.0:1787830349.801167:0:14982:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787830349.801171:0:14982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787830349.801184:0:14982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25929b4780 x1874675316828160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830349.801518:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316827648:0@lo:8:kworker.0 00000100:00100000:0.0:1787830349.801597:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.801631:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316828160:0@lo:8:kworker.0 00000100:00100000:0.0:1787830349.801649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787830349.801687:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25b7c6a940 x1874675316827264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830349.801709:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830349.801721:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787830349.801746:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787830349.801751:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787830349.801754:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2483561000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787830349.801763:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874675316827264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787830349.801803:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316827392:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.801830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.801849:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316828032:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.801870:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.801891:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787830349.801897:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316827520:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.801917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.801927:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316828288:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.801948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.801976:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd321a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316827776:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.802041:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316828416:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.802076:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787830349.802080:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316827904:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.802109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316828544:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.802151:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827648 00000100:00100000:0.0:1787830349.802157:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827648 00000100:00100000:0.0:1787830349.802178:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828160 00000100:00100000:0.0:1787830349.802412:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828160 00000100:00100000:0.0:1787830349.802427:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828032 00000100:00100000:0.0:1787830349.802429:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828032 00000100:00100000:0.0:1787830349.802468:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827520 00000100:00100000:0.0:1787830349.802470:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827520 00000100:00100000:0.0:1787830349.802484:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830349.802492:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316828032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802550:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316828032:12345-0@lo:400:kworker.0 Request processed in 58us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.802556:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787830349.802571:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830349.802576:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316827520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802609:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316827520:12345-0@lo:400:kworker.0 Request processed in 33us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.802614:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787830349.802623:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830349.802633:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316827648:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787830349.802682:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316827648:12345-0@lo:8:kworker.0 Request processed in 48us (1085us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787830349.802688:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830349.802711:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787830349.802715:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316828160:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787830349.802772:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874675316828160:12345-0@lo:8:kworker.0 Request processed in 55us (1122us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787830349.802778:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787830349.802800:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827392 00000100:00100000:0.0:1787830349.802803:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827392 00000100:00100000:0.0:1787830349.802826:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827904 00000100:00100000:0.0:1787830349.802829:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827904 00000100:00100000:0.0:1787830349.802842:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787830349.802848:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316827392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802880:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316827392:12345-0@lo:400:kworker.0 Request processed in 33us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.802885:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787830349.802894:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830349.802900:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316827904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.802929:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316827904:12345-0@lo:400:kworker.0 Request processed in 30us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.802935:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787830349.802950:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828288 00000100:00100000:0.0:1787830349.802953:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828288 00000100:00100000:0.0:1787830349.802972:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316827776 00000100:00100000:0.0:1787830349.802974:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316827776 00000100:00100000:0.0:1787830349.802982:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828416 00000100:00100000:0.0:1787830349.802990:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828416 00000100:00100000:0.0:1787830349.803001:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828544 00000100:00100000:0.0:1787830349.803003:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828544 00000100:00100000:0.0:1787830349.803013:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830349.803017:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316828288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803044:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316828288:12345-0@lo:400:kworker.0 Request processed in 26us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.803049:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787830349.803058:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830349.803062:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316827776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803095:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316827776:12345-0@lo:400:kworker.0 Request processed in 32us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.803100:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787830349.803110:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830349.803114:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316828416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803134:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316828416:12345-0@lo:400:kworker.0 Request processed in 19us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.803139:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787830349.803147:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830349.803152:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316828544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803170:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316828544:12345-0@lo:400:kworker.0 Request processed in 18us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.803175:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787830349.803217:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316827520:0@lo:400:kworker.0 00010000:00080000:0.0:1787830349.803228:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25929b4b40 x1874675316828288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830349.803250:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316828288:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803262:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316827392:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803272:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316828032:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803314:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316827904:0@lo:400:kworker.0 00010000:00080000:0.0:1787830349.803324:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25929b5e00 x1874675316828544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830349.803332:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316828544:0@lo:400:kworker.0 00010000:00080000:0.0:1787830349.803341:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bd321a40 x1874675316827776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830349.803348:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd321a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316827776:0@lo:400:kworker.0 00010000:00080000:0.0:1787830349.803358:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25929b5680 x1874675316828416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830349.803365:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316828416:0@lo:400:kworker.0 00000100:00100000:0.0:1787830349.803406:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830349.803412:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830349.803415:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787830349.803418:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316827648:0@lo:8:kworker.0 00000100:00100000:0.0:1787830349.803426:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830349.803428:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787830349.803431:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787830349.803434:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316828160:0@lo:8:kworker.0 00000020:01000004:0.0:1787830349.804456:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787830349.804474:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f25865bb370) 00000020:00000080:0.0:1787830349.804498:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787830349.804575:0:24997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f258971f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787830349.804578:0:24997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f258971f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787830349.804581:0:24997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f258971f800 3 00010000:00080000:0.0:1787830349.804606:0:24997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f248300f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1787830349.810631:0:24997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787830349.810851:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787830349.810901:0:24997:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787830349.810916:0:24997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8eaa8d1f2dfc2737 00000100:00080000:0.0:1787830349.810927:0:24997:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787830349.810934:0:24997:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f248300f000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830349.810970:0:24997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f25bb5f8000 x1874675316828672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830349.811008:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874675316828672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787830349.811077:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.811143:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828672 00000100:00100000:0.0:1787830349.811151:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828672 00000100:00100000:0.0:1787830349.814622:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787830349.814639:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874675316828672:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787830349.814682:0:22660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:0.0:1787830349.814758:0:22660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8eaa8d1f2dfc273e 00000004:00100000:0.0:1787830349.814778:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787830349.816823:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9f248300a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830349.816940:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874675316828672:12345-0@lo:38:llog_process_th.0 Request processed in 2298us (5859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.816964:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787830349.822886:0:24997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:0.0:1787830349.824614:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f25bb5f8000 x1874675316828672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787830359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830349.824632:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787830349.824645:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787830349.824657:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787830349.824664:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787830349.824668:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f248300f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787830349.824676:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874675316828672:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787830349.824898:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787830349.825109:0:24984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787830349.825146:0:24984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787830349.825171:0:24984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2714 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830349.825193:0:24984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f24825e2a00/0x8eaa8d1f2dfc270d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2714 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787830349.825270:0:24984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787830349.825273:0:24984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787830349.825274:0:24984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830349.825276:0:24984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830349.825277:0:24984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830349.825278:0:24984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830349.825280:0:24984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830349.825281:0:24984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830349.825283:0:24984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787830349.825287:0:24984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787830349.825289:0:24984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787830349.825290:0:24984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787830349.825291:0:24984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787830349.825293:0:24984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787830349.825293:0:24984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787830349.825294:0:24984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787830349.825296:0:24984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787830349.825297:0:24984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787830349.825298:0:24984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787830349.825321:0:24984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787830349.825340:0:24984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316828800:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787830349.826915:0:24984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830349.826993:0:24984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25904a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787830349.832554:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828800 00000100:00100000:1.0:1787830349.832574:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828800 00000100:00100000:1.0:1787830349.832658:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787830349.832671:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316828800:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787830349.832743:0:22656:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787830349.832761:0:22656:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787830349.845909:0:22656:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787830349.845927:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787830349.846130:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787830349.846136:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787830349.846159:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846178:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846186:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846211:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846252:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846265:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 24 pid: 22653 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830349.846280:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316828928:0@lo:104: 00000100:00100000:3.0:1787830349.846351:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787830349.846418:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846426:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 24 pid: 22656 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830349.846434:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316829056:0@lo:104: 00000100:00100000:3.0:1787830349.846457:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830349.846618:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b87dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830349.846644:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316828928 00000100:00100000:3.0:1787830349.846653:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316828928 00000100:00100000:3.0:1787830349.846708:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829056 00000100:00100000:3.0:1787830349.846711:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829056 00000100:00100000:3.0:1787830349.846751:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830349.846760:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316828928:12345-0@lo:104: 00010000:00010000:3.0:1787830349.846773:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846844:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787830349.846851:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+4:22676:x1874675316828928:12345-0@lo:104: Request processed in 93us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.846858:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830349.846875:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787830349.846882:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316829056:12345-0@lo:104: 00010000:00010000:3.0:1787830349.846889:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830349.846918:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787830349.846923:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+3:22676:x1874675316829056:12345-0@lo:104: Request processed in 43us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830349.846928:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787830349.846966:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316828928:0@lo:104: 00000100:00100000:3.0:1787830349.846974:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874675316829056:0@lo:104: 00010000:00010000:3.0:1787830349.846995:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830349.851862:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:24984:x1874675316828800:12345-0@lo:253:mount.lustre.0 Request processed in 19182us (24943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830349.851877:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:0.0:1787830349.852628:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830349.852643:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852658:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d0c00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830349.852662:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852674:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830349.852682:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830349.852688:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787830349.852778:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852804:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830349.852827:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852834:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21d0c00/0x8eaa8d1f2dfc25d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc25e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852851:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830349.852855:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852860:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d1e00 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830349.852863:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852870:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830349.852877:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830349.852882:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787830349.852899:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852905:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830349.852911:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852917:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25c21d1e00/0x8eaa8d1f2dfc25cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc25d2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.852939:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830349.852941:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830349.852942:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830349.852950:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830349.852979:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316829184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830349.853026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.853074:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787830349.853080:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316829312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830349.853102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830349.853140:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829184 00000100:00100000:0.0:1787830349.853148:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829184 00010000:00010000:0.0:1787830349.853174:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 24 pid: 22653 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830349.853197:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829312 00000100:00100000:0.0:1787830349.853199:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829312 00010000:00010000:0.0:1787830349.853209:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 25 pid: 22656 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830349.853228:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830349.853237:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd321a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f65c475-02cd-4018-98b1-85148034a57b+25:3637:x1874675316829184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830349.853251:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830349.853256:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 25 pid: 22653 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853267:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 25 pid: 22653 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853294:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25bd1ba800/0x8eaa8d1f2dfc25e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25d9 expref: 25 pid: 22653 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853309:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830349.853341:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd321a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f65c475-02cd-4018-98b1-85148034a57b+24:3637:x1874675316829184:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.853350:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787830349.853368:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830349.853374:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f65c475-02cd-4018-98b1-85148034a57b+23:3637:x1874675316829312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830349.853382:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830349.853387:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 23 pid: 22656 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853396:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 23 pid: 22656 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853406:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25906c9c00/0x8eaa8d1f2dfc25d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc25cb expref: 23 pid: 22656 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853419:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853428:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787830349.853445:0:22648:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007309949s 00010000:00010000:0.0:1787830349.853450:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853469:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853592:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853601:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853607:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21fe400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830349.853611:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853619:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853634:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853645:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830349.853670:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f65c475-02cd-4018-98b1-85148034a57b+22:3637:x1874675316829312:12345-0@lo:103:ldlm_bl.0 Request processed in 297us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830349.853677:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830349.853755:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316829312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830349.853766:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f65c475-02cd-4018-98b1-85148034a57b:3637:1874675316829184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830349.853795:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853803:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830349.853817:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21fe400/0x8eaa8d1f2dfc2745 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830349.854773:0:24984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f65c475-02cd-4018-98b1-85148034a57b:24984:1874675316828800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787830349.854790:0:24984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787830349.854795:0:24984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787830349.854797:0:24984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787830349.854798:0:24984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787830349.854799:0:24984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787830349.854801:0:24984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787830349.854802:0:24984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787830349.854803:0:24984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787830349.854815:0:24984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787830349.854816:0:24984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787830349.854831:0:24984:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1787830349.865937:0:24984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787830349.880076:0:24984:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787830349.880088:0:24984:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787830349.880123:0:24984:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787830349.880170:0:24984:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787830349.880188:0:24984:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787830349.880228:0:24984:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787830349.881112:0:24984:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787830349.881315:0:24984:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787830350.461015:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830350.588990:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830350.589027:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316829440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830350.589147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830350.589263:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829440 00000100:00100000:3.0:1787830350.589291:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829440 00000100:00100000:3.0:1787830350.589393:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787830350.589407:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316829440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830350.589451:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787830350.589513:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316829440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830350.589522:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787830350.589815:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830350.589868:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316829440:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787830350.910463:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1787830351.073664:0:25050:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787830351.080691:0:25050:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787830351.102868:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316829568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830351.102988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830351.103252:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829568 00000100:00100000:3.0:1787830351.103263:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829568 00000100:00100000:3.0:1787830351.103342:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787830351.103367:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316829568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830351.103419:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787830351.103489:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316829568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830351.103498:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830351.105711:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316829568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787830351.109540:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830351.109576:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316829696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830351.109713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830351.109825:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829696 00000100:00100000:3.0:1787830351.109835:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829696 00000100:00100000:3.0:1787830351.110106:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830351.110118:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316829696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830351.110172:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787830351.110240:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316829696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830351.110248:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787830351.110309:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316829696:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1787830351.164917:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787830351.164929:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f25896b5800 from 14 10000000:01000000:1.0:1787830351.164937:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787830351.165015:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830351.165031:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830351.165046:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830351.165084:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316829824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830351.165178:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830351.165238:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f258800ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830351.165352:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829824 00000100:00100000:3.0:1787830351.165362:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829824 00000100:00100000:3.0:1787830351.165434:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787830351.165445:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316829824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830351.165464:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830351.165483:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25c21ff600/0x8eaa8d1f2dfc2753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc274c expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.165513:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25c21ff600/0x8eaa8d1f2dfc2753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc274c expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.165526:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25c21ff600/0x8eaa8d1f2dfc2753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc274c expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.165536:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25c21ff600, rc 0) 00000100:00100000:3.0:1787830351.165592:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316829824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830351.165609:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787830351.165689:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316829824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830351.165707:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2753 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830351.165716:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2753 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830351.165799:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316829952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787830351.165830:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830351.165848:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f258800ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830351.165967:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316829952 00000100:00100000:2.0:1787830351.165973:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316829952 00000100:00100000:2.0:1787830351.166010:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787830351.166018:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316829952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787830351.166035:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787830351.166056:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787830351.166059:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787830351.166163:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316829952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830351.166170:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787830351.166307:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316829952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787830351.166393:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787830351.166402:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2753 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.166411:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25814b2400/0x8eaa8d1f2dfc274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2753 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787830351.166421:0:22658:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787830351.166423:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f24833f4800 from 14 10000000:01000000:3.0:1787830351.166426:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787830351.166446:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.166454:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.166463:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830351.166478:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316830080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787830351.166509:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830351.166538:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb686000 going to sleep for 11 seconds 00000100:00100000:2.0:1787830351.168090:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830080 00000100:00100000:2.0:1787830351.168109:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830080 00000100:00100000:2.0:1787830351.168185:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787830351.168198:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316830080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830351.168219:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830351.168240:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c8600/0x8eaa8d1f2dfc2761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc275a expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830351.168276:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c8600/0x8eaa8d1f2dfc2761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc275a expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830351.168288:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c8600/0x8eaa8d1f2dfc2761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc275a expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830351.168298:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8600, rc 0) 00000100:00100000:2.0:1787830351.168385:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316830080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830351.168414:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787830351.168451:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316830080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830351.168473:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2761 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830351.168497:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2761 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830351.168573:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316830208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787830351.168619:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830351.168665:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb686000 going to sleep for 11 seconds 00000100:00100000:1.0:1787830351.168973:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830208 00000100:00100000:1.0:1787830351.168980:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830208 00000100:00100000:1.0:1787830351.169024:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787830351.169032:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316830208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787830351.169049:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787830351.169068:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787830351.169071:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787830351.169178:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316830208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830351.169186:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787830351.169346:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316830208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787830351.169434:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787830351.169443:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2761 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830351.169453:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25c21fe000/0x8eaa8d1f2dfc275a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2761 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830351.485419:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787830352.510855:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830353.532968:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830353.661078:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830353.661114:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316830336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787830353.661486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830353.661603:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830336 00000100:00100000:0.0:1787830353.661615:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830336 00000100:00100000:0.0:1787830353.661714:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787830353.661753:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316830336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830353.661804:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830353.661864:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316830336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830353.661872:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787830353.661973:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830353.662028:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316830336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787830354.558164:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787830355.198985:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830355.198992:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787830355.198995:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830355.199020:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f25bc677000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830355.199047:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2483795680 x1874675316830848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787830355.199086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787830355.199090:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787830355.199092:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787830355.199097:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f2481b0a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787830355.199107:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2483794f00 x1874675316831360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787830355.199168:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316830464:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.199249:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.199289:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483794780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316831104:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.199315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.199335:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316831744:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.199358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.199381:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787830355.199388:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316830592:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200112:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316831232:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200160:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874675316831872:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200215:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316830720:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200266:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316831488:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200309:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316832000:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200355:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787830355.200360:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316830976:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200391:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483794b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316831616:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.200421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200447:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316830848:0@lo:8:kworker.0 00000100:00100000:0.0:1787830355.200472:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200487:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316831360:0@lo:8:kworker.0 00000100:00100000:0.0:1787830355.200506:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.200548:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830464 00000100:00100000:0.0:1787830355.200565:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830464 00000100:00100000:2.0:1787830355.200644:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831104 00000100:00100000:2.0:1787830355.200649:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831104 00000100:00100000:2.0:1787830355.200678:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830592 00000100:00100000:2.0:1787830355.200682:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830592 00000100:00100000:2.0:1787830355.200698:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830355.200707:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316831104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.200800:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483796580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316831104:12345-0@lo:400:kworker.0 Request processed in 94us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.200808:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830355.200826:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830355.200832:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316830592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.200873:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316830592:12345-0@lo:400:kworker.0 Request processed in 41us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.200879:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787830355.200897:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831232 00000100:00100000:2.0:1787830355.200900:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831232 00000100:00100000:2.0:1787830355.200928:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830720 00000100:00100000:2.0:1787830355.200931:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830720 00000100:00100000:2.0:1787830355.200941:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830848 00000100:00100000:2.0:1787830355.200944:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830848 00000100:00100000:2.0:1787830355.200964:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831360 00000100:00100000:2.0:1787830355.200967:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831360 00000100:00100000:2.0:1787830355.200976:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830355.200981:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316831232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.201014:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316831232:12345-0@lo:400:kworker.0 Request processed in 33us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.201020:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787830355.201030:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830355.201036:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316830720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.201065:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483796d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316830720:12345-0@lo:400:kworker.0 Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.201070:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787830355.201079:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830355.201082:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1874675316830848:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787830355.201106:0:24170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:2.0:1787830355.201133:0:24170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8eaa8d1f2dfc2768 00002000:00100000:2.0:1787830355.201145:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f2481b5a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787830355.201150:0:24170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787830355.201153:0:24170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787830355.201337:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787830355.201364:0:24170:0:(import.c:65:import_set_state_nolock()) ffff9f2481b5e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830355.201403:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874675316830848:12345-0@lo:8:kworker.0 Request processed in 319us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.201409:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787830355.201422:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787830355.201426:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1874675316831360:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787830355.201447:0:24170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:2.0:1787830355.201463:0:24170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8eaa8d1f2dfc276f 00002000:00100000:2.0:1787830355.201468:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f2481b5f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787830355.201472:0:24170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787830355.201473:0:24170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787830355.201493:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787830355.201504:0:24170:0:(import.c:65:import_set_state_nolock()) ffff9f2481b58000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830355.201529:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1874675316831360:12345-0@lo:8:kworker.0 Request processed in 101us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.201534:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787830355.201554:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830355.201582:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd323c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316830592:0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.201606:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316831232:0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.201618:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483794780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316831104:0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.206267:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831744 00000100:00100000:2.0:1787830355.206282:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831744 00000100:00100000:2.0:1787830355.206342:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831872 00000100:00100000:2.0:1787830355.206347:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831872 00000100:00100000:2.0:1787830355.206364:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831488 00000100:00100000:2.0:1787830355.206366:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831488 00000100:00100000:2.0:1787830355.206378:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832000 00000100:00100000:2.0:1787830355.206380:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832000 00000100:00100000:2.0:1787830355.206392:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316830976 00000100:00100000:2.0:1787830355.206394:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316830976 00000100:00100000:2.0:1787830355.206403:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316831616 00000100:00100000:2.0:1787830355.206406:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316831616 00000100:00100000:2.0:1787830355.206437:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787830355.206447:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316831744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.206744:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483797c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316831744:12345-0@lo:400:kworker.0 Request processed in 279us (7365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.206753:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787830355.206772:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787830355.206987:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874675316831872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.207026:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483795e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874675316831872:12345-0@lo:400:kworker.0 Request processed in 46us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.207032:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787830355.207045:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787830355.207051:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.207081:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483795a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316831488:12345-0@lo:400:kworker.0 Request processed in 30us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.207087:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787830355.207098:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787830355.207105:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316832000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.207134:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316832000:12345-0@lo:400:kworker.0 Request processed in 30us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.207140:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787830355.207152:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830355.207158:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316830976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.207186:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316830976:12345-0@lo:400:kworker.0 Request processed in 28us (6804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.207191:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787830355.207203:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787830355.207209:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316831616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830355.207247:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316831616:12345-0@lo:400:kworker.0 Request processed in 39us (6836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830355.207254:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787830355.207291:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787830355.207295:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787830355.207332:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24837952c0 x1874675316831872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830355.207347:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874675316831872:0@lo:400:kworker.0 00010000:00080000:2.0:1787830355.207362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483797480 x1874675316831744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830355.207371:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316831744:0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.211609:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787830355.211641:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:3639:x1874675316830464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830355.211803:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:3639:x1874675316830464:12345-0@lo:400:kworker.0 Request processed in 178us (12554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830355.211812:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787830355.212047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316830464:0@lo:400:kworker.0 00010000:00080000:1.0:1787830355.214334:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483795680 x1874675316830848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830355.214358:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787830355.214367:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787830355.214373:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787830355.214377:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f25bc677000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787830355.214405:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787830355.214426:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874675316830848:0@lo:8:kworker.0 00010000:00080000:1.0:1787830355.214447:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483794f00 x1874675316831360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787830380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787830355.214458:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787830355.214463:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787830355.214466:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787830355.214468:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9f2481b0a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787830355.214478:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787830355.214481:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874675316831360:0@lo:8:kworker.0 00000004:00080000:1.0:1787830355.214560:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787830355.214581:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874675316832256:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787830355.214638:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830355.214664:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8957780 going to sleep for 11 seconds 00000004:00080000:1.0:1787830355.214678:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787830355.216352:0:22687:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787830355.216382:0:22687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c6a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874675316832512:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787830355.216383:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830355.216561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787830355.216627:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 744434900811ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787830355.216635:0:23403:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1787830355.217037:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483796940 x1874675316830976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830355.217053:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316830976:0@lo:400:kworker.0 00010000:00080000:1.0:1787830355.217066:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483794b40 x1874675316831616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830355.217074:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483794b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316831616:0@lo:400:kworker.0 00000100:00100000:1.0:1787830355.217086:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bb5f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316830720:0@lo:400:kworker.0 00010000:00080000:1.0:1787830355.217098:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483797840 x1874675316831488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830355.217114:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316831488:0@lo:400:kworker.0 00010000:00080000:1.0:1787830355.217131:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24837961c0 x1874675316832000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830355.217139:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316832000:0@lo:400:kworker.0 00000100:00100000:1.0:1787830355.217171:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830355.217178:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316832128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787830355.217209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830355.217247:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832256 00000100:00100000:1.0:1787830355.217252:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832256 00000100:00100000:1.0:1787830355.217308:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787830355.217317:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23404:x1874675316832256:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787830355.217398:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832384 00000100:00100000:3.0:1787830355.217404:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832384 00000100:00100000:3.0:1787830355.217432:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832128 00000100:00100000:3.0:1787830355.217436:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832128 00000100:00100000:3.0:1787830355.217453:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830355.217461:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25929b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874675316832384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787830355.217483:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00080000:1.0:1787830355.217523:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787830355.217538:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25929b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874675316832384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830355.217546:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787830355.217565:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787830355.217572:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1874675316832128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787830355.217600:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787830355.217636:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1874675316832128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830355.217643:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787830355.217688:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bd298b40 x1874675316832128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830355.217705:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd298b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316832128:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787830355.217752:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25b7c69680 x1874675316832384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787830371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830355.217765:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316832384:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787830355.221273:0:22686:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787830355.221386:0:22686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744439660655ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787830355.221395:0:22686:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787830355.228223:0:22641:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787830355.228311:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830355.228367:0:22687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2584f5ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787830355.230757:0:24167:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787830355.230780:0:24167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787830355.231238:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832512 00000100:00100000:2.0:1787830355.231249:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832512 00000100:00100000:3.0:1787830355.231529:0:25270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787830355.231541:0:25270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22687:x1874675316832512:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787830355.232903:0:23393:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787830355.243915:0:25270:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787830355.243931:0:25270:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787830355.243937:0:25270:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:0.0:1787830355.247033:0:24170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787830355.247045:0:24170:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787830355.247143:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23404:x1874675316832256:12345-0@lo:7:osp-pre-1-1.0 Request processed in 29823us (32501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830355.247153:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787830355.247267:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bd29ad00 x1874675316832256/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787830371 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830355.247287:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874675316832256:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787830355.247306:0:23404:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787830355.247350:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874675316832640:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787830355.247389:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830355.247434:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25b8957780 going to sleep for 11 seconds 00000100:00100000:0.0:1787830355.249546:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832640 00000100:00100000:0.0:1787830355.249557:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832640 00000100:00100000:0.0:1787830355.249624:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787830355.249635:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1874675316832640:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787830355.249672:0:24167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787830355.249773:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1874675316832640:12345-0@lo:5:osp-pre-1-1.0 Request processed in 131us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830355.249781:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787830355.249819:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bd29ad00 x1874675316832640/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787830371 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787830355.249833:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874675316832640:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787830355.249845:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787830355.249886:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874675316832768:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787830355.249918:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.249938:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f248353b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787830355.249951:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832768 00000100:00100000:0.0:1787830355.249955:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832768 00000100:00100000:0.0:1787830355.249974:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830355.249979:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23404:x1874675316832768:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787830355.250003:0:24170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1787830355.260169:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787830355.260184:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830355.260203:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=744s v=(0 0) 00010000:00010000:2.0:1787830355.260209:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830355.260230:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830355.260257:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830355.260281:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830355.260290:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830355.260319:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830355.260508:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.260516:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.260524:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.260535:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.260545:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.260565:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.260572:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092e736ab/0x8eaa8d1f2dfc2776 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.260601:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.260603:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.260605:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830355.272124:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.272138:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272157:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.272161:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.272167:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272182:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272193:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272208:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272242:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787830355.272708:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.272714:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272743:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.272746:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.272751:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272829:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272839:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272847:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.272865:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787830355.273113:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.273118:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273131:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.273135:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.273138:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273147:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273153:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273160:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273176:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787830355.273191:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787830355.273197:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273205:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b3400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.273209:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273336:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273366:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273373:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc3554b8/0x8eaa8d1f2dfc277d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273395:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830355.273399:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273406:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2600 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.273409:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273417:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273426:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273432:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3ec64ab/0x8eaa8d1f2dfc2784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273445:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.273449:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273461:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.273465:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273472:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273482:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273489:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b93fb38d/0x8eaa8d1f2dfc278b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.273502:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.273504:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.273506:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830355.279029:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.279045:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279063:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.279068:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.279075:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279090:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279117:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279124:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279154:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830355.279174:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.279181:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279189:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.279194:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279203:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279335:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279345:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cebf4b86/0x8eaa8d1f2dfc2792 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.279363:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.279371:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.279373:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.280073:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.280701:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830355.281452:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.281463:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.281477:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.281481:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.281488:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.281501:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.281511:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.281517:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.281548:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787830355.281981:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.281987:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.281995:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.281998:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.282002:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282018:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282026:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282032:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282048:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787830355.282380:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.282387:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282396:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.282399:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.282403:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282412:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282420:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282438:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.282453:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787830355.282742:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787830355.282750:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282759:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b3600 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.282888:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282899:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282918:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282927:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7ed0d95/0x8eaa8d1f2dfc2799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282949:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830355.282952:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282958:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b3000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.282960:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282967:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282975:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282981:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad59df6a/0x8eaa8d1f2dfc27a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.282997:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830355.283000:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.283006:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25814b2800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.283010:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.283017:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.283027:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.283034:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4e51ea5/0x8eaa8d1f2dfc27a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.283047:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.283049:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.283051:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.283300:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.283305:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787830355.283408:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.283414:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283424:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.283427:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.283432:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283442:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283449:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283455:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283476:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787830355.283958:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787830355.283964:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283979:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787830355.283982:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830355.283986:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.283997:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.284004:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.284012:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.284032:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830355.284160:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830355.284167:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284175:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d32a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.284178:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284200:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284214:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284222:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4a9ae68/0x8eaa8d1f2dfc27ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284239:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830355.284242:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284248:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d32200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.284250:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284256:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284265:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284278:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f633978f/0x8eaa8d1f2dfc27b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.284300:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.284302:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.284303:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.284518:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830355.284993:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830355.285000:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285010:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787830355.285021:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830355.285026:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285036:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285044:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285050:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285069:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787830355.285201:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830355.285207:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.285215:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.285219:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.285226:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.285238:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.285246:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4bc21fb/0x8eaa8d1f2dfc27bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.285263:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.285265:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.285266:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830355.285479:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830355.285485:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285494:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787830355.285497:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830355.285501:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285510:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285518:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285531:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.285719:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830355.287110:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830355.287120:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.287133:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787830355.287137:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830355.287144:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.287156:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.287165:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.287172:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292223:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830355.292243:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292294:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2e00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.292302:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292314:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292341:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292348:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25b5192/0x8eaa8d1f2dfc27c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292377:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830355.292382:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292388:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.292390:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292398:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292407:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.292421:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.292422:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.292424:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.293390:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787830355.293401:0:25270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000201a7fa1/0x8eaa8d1f2dfc27ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.293481:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787830355.296863:0:24985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787830355.296890:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787830355.296896:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787830355.297166:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23404:x1874675316832768:12345-0@lo:5:osp-pre-1-1.0 Request processed in 47181us (47241us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787830355.297180:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830355.298518:0:23404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787830355.298533:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874675316832768:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787830355.298550:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1787830355.298620:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1874675316832896:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787830355.298669:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830355.298716:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb6860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830355.298873:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316832896 00000100:00100000:1.0:1787830355.298880:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316832896 00000100:00100000:1.0:1787830355.298941:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787830355.298951:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1874675316832896:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787830355.299010:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1874675316832896:12345-0@lo:900:osp-pre-1-1.0 Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830355.299017:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787830355.299061:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25bfbc3480 x1874675316832896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787830371 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830355.299074:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1874675316832896:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1787830355.300241:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.300252:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300269:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.300285:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.300295:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300309:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300318:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300325:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300351:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830355.300776:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.300782:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300803:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.300806:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.300811:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300820:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300828:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300834:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300849:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830355.300860:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830355.300866:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300873:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21fe600 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.300877:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300887:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300917:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300925:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084e45344/0x8eaa8d1f2dfc27d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300944:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830355.300946:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300953:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21ff000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.300956:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300963:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300973:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300980:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aa08199/0x8eaa8d1f2dfc27d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.300992:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.300993:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.301000:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.301378:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.301385:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.301395:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.301398:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.301402:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.301411:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.301419:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.301425:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.301438:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830355.301700:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830355.301707:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.301715:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21fe400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.301719:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.301745:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.301758:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.301787:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfefbfa9/0x8eaa8d1f2dfc27df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.301803:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.301806:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.301807:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.301813:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.302077:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.302083:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302093:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.302096:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.302100:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302121:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302130:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302137:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302161:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830355.302493:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.302499:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302508:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.302510:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.302514:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302524:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302531:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302548:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.302559:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787830355.302902:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830355.302909:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302917:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580031200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.302921:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302929:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302942:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302948:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0d80541/0x8eaa8d1f2dfc27e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302967:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830355.302970:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302982:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580030a00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.302985:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.302992:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.303001:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.303008:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc528ec5/0x8eaa8d1f2dfc27ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.303019:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.303020:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.303022:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.303026:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.303111:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.303116:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303125:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.303127:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.303132:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303140:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303148:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303155:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303175:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830355.303447:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.303453:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303466:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.303469:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.303473:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303481:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303489:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303495:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303513:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787830355.303521:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787830355.303525:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303532:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d1e00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.303535:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303543:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303566:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.303572:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c2b8da/0x8eaa8d1f2dfc27f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304099:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787830355.304105:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304113:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d0c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:3.0:1787830355.304116:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304123:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304136:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304143:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008849a802/0x8eaa8d1f2dfc27fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304159:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.304161:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.304171:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.304374:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.304653:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.304660:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304670:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.304673:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.304678:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304687:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304696:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304704:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.304856:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830355.308129:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.308147:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.308166:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.308171:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.308178:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.308205:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.308215:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.308223:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.310124:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830355.310138:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.310151:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25c21d1800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.310155:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.310180:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.310201:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.310208:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c9a7b7/0x8eaa8d1f2dfc2802 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.310334:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.310341:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.310348:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.310351:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.310359:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.310370:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.310379:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.310380:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.310382:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.310576:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787830355.310585:0:25270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc2809 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787830355.311407:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.311415:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.311430:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.311434:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.311443:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.311457:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.311478:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.311486:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.311500:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787830355.311824:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830355.311830:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.311837:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.311841:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.311848:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.311862:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.311868:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc3b274f/0x8eaa8d1f2dfc2810 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.311900:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.311902:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.311903:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.311910:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787830355.312340:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830355.312347:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312358:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787830355.312362:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830355.312366:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312375:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312383:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312389:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312409:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787830355.312905:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787830355.312912:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312932:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787830355.312935:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787830355.312939:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312949:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312957:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.312965:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.313054:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.313060:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.313068:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.313071:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.313089:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.313102:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.313109:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6fbdbf5/0x8eaa8d1f2dfc2817 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.313125:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.313127:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.313128:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787830355.313172:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830355.313490:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.313497:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.313506:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.313509:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.313512:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.313520:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.313527:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.313533:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.313567:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787830355.313869:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830355.313875:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313884:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3200 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.313888:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313896:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313920:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313928:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005da6f7a2/0x8eaa8d1f2dfc281e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313943:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830355.313947:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313953:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125e00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830355.313956:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313964:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313974:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313981:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c6225b0/0x8eaa8d1f2dfc2825 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830355.313992:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.313994:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.314002:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.314058:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.314933:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.314943:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.314956:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.314959:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.314966:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.314977:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.314985:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.314993:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.315008:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787830355.316066:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.316075:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.316087:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.316096:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.316102:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.316114:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.316122:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.316128:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.316150:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787830355.316891:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787830355.316901:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.316912:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124800 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.316917:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.316927:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.316947:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.316962:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056417692/0x8eaa8d1f2dfc282c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.316987:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.316991:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.316996:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.316999:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.317005:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.317014:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.317021:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822d916d/0x8eaa8d1f2dfc2833 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.317033:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.317034:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.317036:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830355.317117:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.317462:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.317470:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.317479:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.317483:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.317488:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.317498:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.317507:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.317520:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.317542:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830355.318876:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.318888:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.318910:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.318915:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.318923:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.318942:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.318950:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d971afb/0x8eaa8d1f2dfc283a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.318973:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.318975:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.318977:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.319122:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.319130:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.319139:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.319143:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.319148:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.319157:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.319165:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.319171:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.319194:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787830355.319520:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.319525:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.319533:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124400 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.319536:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.319544:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.319562:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.319570:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e50a06e4/0x8eaa8d1f2dfc2841 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.319585:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.319597:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.319599:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787830355.320149:0:25270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787830355.320156:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.320172:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=744s v=(0 0) 00010000:00010000:3.0:1787830355.320176:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787830355.320181:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.320190:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.320198:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.320205:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830355.320225:0:25270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787830355.320284:0:25270:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1787830355.320390:0:25270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22687:x1874675316832512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88849us (92079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830355.320401:0:25270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787830355.320543:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787830355.320549:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.320556:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124000 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:1.0:1787830355.320560:0:24673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.320569:0:24673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.320582:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.320616:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d6fd8f/0x8eaa8d1f2dfc2848 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830355.320646:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.320648:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787830355.320650:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830355.321173:0:22687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c6a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874675316832512:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787830355.321194:0:22687:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787830355.321244:0:22687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874675316833024:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787830355.321302:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830355.321880:0:22687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25906c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830355.323071:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833024 00000100:00100000:1.0:1787830355.323083:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833024 00000100:00100000:1.0:1787830355.323130:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830355.323140:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22687:x1874675316833024:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787830355.323182:0:24167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1787830355.325347:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22687:x1874675316833024:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2201us (4038us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787830355.325359:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787830355.325429:0:22687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25929b4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874675316833024:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787830355.325444:0:22687:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1787830355.587908:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830355.714545:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316833152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830355.714630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830355.714695:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833152 00000100:00100000:3.0:1787830355.714703:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833152 00000100:00100000:3.0:1787830355.714775:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787830355.714783:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316833152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830355.714813:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787830355.714860:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316833152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830355.714867:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787830355.714885:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316833152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787830356.221064:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787830356.221094:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316833280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830356.221176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830356.221228:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833280 00000100:00100000:0.0:1787830356.221235:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833280 00000100:00100000:0.0:1787830356.221296:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787830356.221305:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316833280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787830356.221341:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787830356.221394:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316833280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830356.221402:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787830356.221458:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316833280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787830356.225772:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316833408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787830356.225846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830356.226020:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833408 00000100:00100000:3.0:1787830356.226028:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833408 00000100:00100000:3.0:1787830356.226083:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830356.226093:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316833408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830356.226142:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787830356.226201:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316833408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830356.226207:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830356.226257:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316833408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787830356.605208:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787830356.941885:0:25341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1787830357.373412:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830357.637220:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787830358.071399:0:25393:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787830358.071694:0:25393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787830358.656420:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830358.788404:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787830358.788430:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316833536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787830358.788516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830358.788578:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833536 00000100:00100000:0.0:1787830358.788598:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833536 00000100:00100000:0.0:1787830358.788673:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787830358.788684:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316833536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830358.788720:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830358.788793:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316833536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830358.788801:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787830358.788822:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830358.788858:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316833536:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1787830359.028565:0:25443:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787830359.028832:0:25443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787830359.442004:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.442160:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295738368 00000100:00100000:2.0:1787830359.442170:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295738368 00000100:00100000:2.0:1787830359.442217:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:2.0:1787830359.442225:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2391:x1874675295738368:12345-192.168.204.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787830359.442256:0:22656:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 81b8f2ab-7870-44f1-93df-2a3b3577fec3@192.168.204.30@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:2.0:1787830359.442291:0:22656:0:(genops.c:1385:class_connect()) connect: client 81b8f2ab-7870-44f1-93df-2a3b3577fec3, cookie 0x8eaa8d1f2dfc284f 00000100:00080000:2.0:1787830359.442439:0:22656:0:(import.c:65:import_set_state_nolock()) ffff9f2481b5c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787830359.442885:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+5:2391:x1874675295738368:12345-192.168.204.30@tcp:250:mount.lustre.0 Request processed in 656us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.442895:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:0.0:1787830359.453922:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.454584:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295738496 00000100:00100000:3.0:1787830359.454596:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295738496 00000100:00100000:3.0:1787830359.454669:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:3.0:1787830359.454680:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+5:18123:x1874675295738496:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787830359.454699:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830359.454766:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2482124600/0x8eaa8d1f2dfc2856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827a6f expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830359.454811:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2482124600/0x8eaa8d1f2dfc2856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a6f expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830359.454823:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2482124600/0x8eaa8d1f2dfc2856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a6f expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830359.454832:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482124600, rc 0) 00000100:00100000:3.0:1787830359.454920:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+6:18123:x1874675295738496:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 242us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830359.454928:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:0.0:1787830359.459444:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.459568:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295738624 00000100:00100000:2.0:1787830359.459594:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295738624 00000100:00100000:2.0:1787830359.459818:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:2.0:1787830359.459832:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+6:18123:x1874675295738624:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787830359.460536:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+6:18123:x1874675295738624:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 700us (1097us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787830359.460548:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:1.0:1787830359.468544:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830359.468757:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295738752 00000100:00100000:0.0:1787830359.468769:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295738752 00000100:00100000:0.0:1787830359.468831:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:0.0:1787830359.468842:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+6:18123:x1874675295738752:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830359.468859:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830359.468877:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24825e2600/0x8eaa8d1f2dfc285d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827a76 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830359.468920:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e2600/0x8eaa8d1f2dfc285d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a76 expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830359.468940:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24825e2600/0x8eaa8d1f2dfc285d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827a76 expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830359.468950:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2600, rc 0) 00000100:00100000:0.0:1787830359.469020:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+7:18123:x1874675295738752:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 172us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830359.469042:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:0.0:1787830359.472534:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.473561:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295738880 00000100:00100000:2.0:1787830359.473574:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295738880 00000100:00100000:2.0:1787830359.473658:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1787830359.473669:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+7:18123:x1874675295738880:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787830359.473883:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18123:x1874675295738880:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 216us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.473892:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1787830359.485002:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830359.485594:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739008 00000100:00100000:0.0:1787830359.485607:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739008 00000100:00100000:2.0:1787830359.485838:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:2.0:1787830359.485851:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18123:x1874675295739008:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787830359.486019:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18123:x1874675295739008:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 171us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.486027:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:1.0:1787830359.499041:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.499146:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739136 00000100:00100000:3.0:1787830359.499158:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739136 00000100:00100000:3.0:1787830359.499219:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:3.0:1787830359.499230:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18142:x1874675295739136:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787830359.499492:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18142:x1874675295739136:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 262us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830359.499501:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:1.0:1787830359.535708:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830359.536648:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739264 00000100:00100000:0.0:1787830359.536662:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739264 00000100:00100000:0.0:1787830359.536965:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:0.0:1787830359.536976:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18142:x1874675295739264:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830359.537202:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18142:x1874675295739264:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 228us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830359.537211:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:0.0:1787830359.554367:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.554623:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739392 00000100:00100000:2.0:1787830359.554635:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739392 00000100:00100000:2.0:1787830359.554695:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:2.0:1787830359.554707:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18142:x1874675295739392:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830359.554943:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18142:x1874675295739392:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 238us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.554963:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:1.0:1787830359.559501:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830359.559650:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739520 00000100:00100000:0.0:1787830359.559664:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739520 00000100:00100000:0.0:1787830359.559804:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:0.0:1787830359.559818:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+8:18123:x1874675295739520:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830359.559842:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830359.559868:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24825e2000/0x8eaa8d1f2dfc2864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827aa7 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830359.559907:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e2000/0x8eaa8d1f2dfc2864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aa7 expref: 9 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830359.559921:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24825e2000/0x8eaa8d1f2dfc2864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aa7 expref: 9 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830359.559931:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2000, rc 0) 00000100:00100000:0.0:1787830359.560021:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+9:18123:x1874675295739520:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 207us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830359.560030:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:1.0:1787830359.570572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.570776:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739648 00000100:00100000:3.0:1787830359.570790:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739648 00000100:00100000:3.0:1787830359.570853:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:3.0:1787830359.570863:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+9:18123:x1874675295739648:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787830359.570898:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787830359.570930:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787830359.570935:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787830359.570939:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787830359.570943:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787830359.570951:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787830359.578222:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+9:18123:x1874675295739648:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 6376us (6684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830359.578246:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:1.0:1787830359.583184:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.583402:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739776 00000100:00100000:2.0:1787830359.583417:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739776 00000100:00100000:2.0:1787830359.583524:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:2.0:1787830359.583537:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+9:18123:x1874675295739776:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787830359.583562:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830359.583589:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827aae expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830359.583635:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830359.583650:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830359.583662:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8a00, rc 0) 00000100:00100000:2.0:1787830359.583791:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18123:x1874675295739776:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 257us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.583799:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:1.0:1787830359.587143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.587450:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295739904 00000100:00100000:3.0:1787830359.587542:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295739904 00000100:00100000:3.0:1787830359.587617:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:3.0:1787830359.587630:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18123:x1874675295739904:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787830359.589748:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18123:x1874675295739904:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 2094us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830359.589769:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:3.0:1787830359.610760:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830359.611775:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740032 00000100:00100000:0.0:1787830359.611797:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740032 00000100:00100000:0.0:1787830359.611901:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:0.0:1787830359.611914:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18123:x1874675295740032:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787830359.612143:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18123:x1874675295740032:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 231us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830359.612153:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:1.0:1787830359.623246:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.623597:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740160 00000100:00100000:3.0:1787830359.623612:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740160 00000100:00100000:3.0:1787830359.623692:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:3.0:1787830359.623704:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18147:x1874675295740160:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787830359.623976:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18147:x1874675295740160:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 272us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830359.623986:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:1.0:1787830359.647709:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.647903:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740288 00000100:00100000:3.0:1787830359.647914:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740288 00000100:00100000:2.0:1787830359.649874:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:2.0:1787830359.649909:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18147:x1874675295740288:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787830359.650918:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18147:x1874675295740288:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 1027us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.651005:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:2.0:1787830359.664240:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.665446:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.665546:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830359.666003:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740416 00000100:00100000:0.0:1787830359.666015:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740416 00000100:00100000:0.0:1787830359.666095:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740672 00000100:00100000:0.0:1787830359.666100:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740672 00000100:00100000:0.0:1787830359.666120:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787830359.666128:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1874675295740416:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787830359.666163:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9a02fe4e-043f-4c80-a280-961ccf82a0ae@192.168.204.30@tcp t0 exp 0000000000000000 cur 748 last 0 00000100:00100000:3.0:1787830359.666215:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000020:00000080:0.0:1787830359.666218:0:22662:0:(genops.c:1385:class_connect()) connect: client 9a02fe4e-043f-4c80-a280-961ccf82a0ae, cookie 0x8eaa8d1f2dfc2872 00000100:00100000:3.0:1787830359.666242:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2391:x1874675295740672:12345-192.168.204.30@tcp:38:mount.lustre.0 00000004:00100000:0.0:1787830359.666246:0:22662:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:3.0:1787830359.666294:0:24451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9a02fe4e-043f-4c80-a280-961ccf82a0ae@192.168.204.30@tcp t0 exp 0000000000000000 cur 748 last 0 00000100:00080000:0.0:1787830359.666519:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9f248300e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830359.666601:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2391:x1874675295740416:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 471us (2370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830359.666610:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1787830359.666986:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741056 00000100:00100000:1.0:1787830359.666992:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741056 00000100:00100000:1.0:1787830359.667046:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:1.0:1787830359.667056:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:2394:x1874675295741056:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830359.667115:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:2394:x1874675295741056:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 61us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.667123:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 133 00000020:00000080:0.0:1787830359.672847:0:24451:0:(genops.c:1385:class_connect()) connect: client 9a02fe4e-043f-4c80-a280-961ccf82a0ae, cookie 0x8eaa8d1f2dfc2879 00000004:00100000:0.0:1787830359.672892:0:24451:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787830359.675166:0:24451:0:(import.c:65:import_set_state_nolock()) ffff9f2483009800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787830359.675483:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2391:x1874675295740672:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 9250us (11135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830359.675496:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00010000:00010000:3.0:1787830359.678833:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830359.696155:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830359.700010:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830359.710802:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740544 00000100:00100000:1.0:1787830359.710827:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740544 00000100:00100000:1.0:1787830359.711000:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740928 00000100:00100000:1.0:1787830359.711005:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740928 00000100:00100000:1.0:1787830359.711043:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787830359.711064:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:0:x1874675295740544:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787830359.711113:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787830359.711221:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:0:x1874675295740544:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 168us (15077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.711229:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787830359.711250:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787830359.711257:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295740928:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787830359.711269:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787830359.711306:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295740928:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 49us (11304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.711313:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00080000:2.0:1787830359.712006:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830359.718423:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830359.718572:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295740800 00000100:00100000:1.0:1787830359.718583:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295740800 00000100:00100000:1.0:1787830359.718670:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:1.0:1787830359.718683:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:0:x1874675295740800:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787830359.718767:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787830359.718867:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:0:x1874675295740800:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 187us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.718882:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00080000:2.0:1787830359.718962:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830359.722862:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.722989:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741184 00000100:00100000:3.0:1787830359.723000:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741184 00000100:00100000:3.0:1787830359.723166:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:3.0:1787830359.723176:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295741184:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787830359.723285:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295741184:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 102us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830359.723292:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:3.0:1787830359.740631:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.740695:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830359.740911:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830359.740982:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741568 00000100:00100000:1.0:1787830359.740996:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741568 00000100:00100000:1.0:1787830359.741080:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1787830359.741091:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295741568:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787830359.741222:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295741568:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 132us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.741231:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1787830359.749766:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830359.749962:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741696 00000100:00100000:1.0:1787830359.749974:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741696 00000100:00100000:1.0:1787830359.750124:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787830359.750130:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741312 00000100:00100000:1.0:1787830359.750141:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295741696:12345-192.168.204.30@tcp:33:mount.lustre.0 00000100:00100000:0.0:1787830359.750145:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741312 00000100:00100000:1.0:1787830359.750362:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741440 00000100:00100000:1.0:1787830359.750368:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741440 00000100:00100000:1.0:1787830359.750669:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1787830359.750675:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1874675295741312:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787830359.750706:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9a02fe4e-043f-4c80-a280-961ccf82a0ae@192.168.204.30@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1787830359.750765:0:24167:0:(genops.c:1385:class_connect()) connect: client 9a02fe4e-043f-4c80-a280-961ccf82a0ae, cookie 0x8eaa8d1f2dfc2880 00002000:00100000:1.0:1787830359.750781:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9a02fe4e-043f-4c80-a280-961ccf82a0ae/ffff9f2483563800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787830359.750794:0:24167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787830359.750999:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787830359.751039:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9f2483560800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830359.751122:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2391:x1874675295741312:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 444us (10425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.751149:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1787830359.751178:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1787830359.751183:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1874675295741440:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787830359.751203:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9a02fe4e-043f-4c80-a280-961ccf82a0ae@192.168.204.30@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1787830359.751243:0:24167:0:(genops.c:1385:class_connect()) connect: client 9a02fe4e-043f-4c80-a280-961ccf82a0ae, cookie 0x8eaa8d1f2dfc2887 00002000:00100000:1.0:1787830359.751537:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9a02fe4e-043f-4c80-a280-961ccf82a0ae/ffff9f25b867a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787830359.751559:0:24167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787830359.751719:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787830359.751760:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9f25b8678000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830359.751792:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2391:x1874675295741440:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 607us (10879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830359.751862:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000004:00080000:1.0:1787830359.753992:0:22663:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3680us 00000004:00200000:2.0:1787830359.782782:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787830359.782958:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18123:x1874675295741696:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 32816us (33196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830359.782973:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1787830360.088635:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830360.089354:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741824 00000100:00100000:1.0:1787830360.089367:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741824 00000100:00100000:1.0:1787830360.089439:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787830360.089451:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18170:x1874675295741824:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:1.0:1787830360.089476:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830360.089517:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33400/0x8eaa8d1f2dfc288e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827adf expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830360.089596:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33000/0x8eaa8d1f2dfc2895 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830360.089611:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33000/0x8eaa8d1f2dfc2895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830360.089658:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33000/0x8eaa8d1f2dfc2895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830360.089717:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787830360.089722:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830360.089823:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33000/0x8eaa8d1f2dfc2895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830360.089855:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33400/0x8eaa8d1f2dfc288e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827adf expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830360.089877:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33000/0x8eaa8d1f2dfc2895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827adf expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830360.089886:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:1.0:1787830360.089890:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830360.089894:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25b7d33000, rc 0) 00000100:00100000:1.0:1787830360.089974:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18170:x1874675295741824:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 525us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.089982:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000040:00080000:2.0:1787830360.125974:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787830360.317276:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316833664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830360.317351:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830360.317659:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833664 00000100:00100000:1.0:1787830360.317668:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833664 00000100:00100000:1.0:1787830360.317767:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787830360.317777:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874675316833664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787830360.317798:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787830360.317844:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874675316833664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.317874:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787830360.318088:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830360.318141:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd29bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316833664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787830360.318483:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830360.319759:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316833920:0@lo:400:kworker.0 00000100:00100000:3.0:1787830360.319844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830360.320025:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316833792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830360.320084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830360.320386:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833792 00000100:00100000:1.0:1787830360.320394:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833792 00000100:00100000:1.0:1787830360.320451:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787830360.320460:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316833792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787830360.320483:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787830360.320538:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316833792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.320545:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787830360.320866:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316833792:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787830360.320925:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830360.321294:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316834176:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.321335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830360.321356:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316834688:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.321535:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316834304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.321568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830360.321591:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316834816:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.321614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830360.321643:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787830360.321650:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316834432:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.321719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830360.321757:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874675316834944:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.321810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830360.321844:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834432 00000100:00100000:1.0:1787830360.321849:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834432 00000100:00100000:1.0:1787830360.321886:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830360.322477:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316834432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.322551:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316834432:12345-0@lo:400:kworker.0 Request processed in 658us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.322560:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787830360.322628:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483797840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316834432:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.322655:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834304 00000100:00100000:1.0:1787830360.322659:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834304 00000100:00100000:1.0:1787830360.322707:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834816 00000100:00100000:1.0:1787830360.322711:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834816 00000100:00100000:1.0:1787830360.322949:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834944 00000100:00100000:1.0:1787830360.322953:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834944 00000100:00100000:1.0:1787830360.322967:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787830360.322974:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316834304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.323012:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316834304:12345-0@lo:400:kworker.0 Request processed in 39us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.323018:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787830360.323029:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830360.323034:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316834816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.323061:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316834816:12345-0@lo:400:kworker.0 Request processed in 27us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.323067:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787830360.323079:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787830360.323084:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874675316834944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.323107:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874675316834944:12345-0@lo:400:kworker.0 Request processed in 24us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.323113:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787830360.323155:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f2483795680 x1874675316834944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787830360.323166:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483795680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874675316834944:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.323178:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316834304:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.323199:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483794f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316834816:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.323709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830360.323761:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874675316835200:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.323832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830360.323857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787830360.323864:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b7c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316834048:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.323890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830360.324078:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483794b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316834560:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.324134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830360.324154:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874675316835072:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.324188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830360.324222:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834688 00000100:00100000:2.0:1787830360.324227:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834688 00000100:00100000:2.0:1787830360.324261:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835200 00000100:00100000:2.0:1787830360.324263:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835200 00000100:00100000:2.0:1787830360.324278:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835072 00000100:00100000:2.0:1787830360.324280:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835072 00000100:00100000:2.0:1787830360.324294:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830360.324300:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316834688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.324346:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874675316834688:12345-0@lo:400:kworker.0 Request processed in 46us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830360.324352:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787830360.324510:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787830360.324518:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874675316835200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.324549:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483794f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874675316835200:12345-0@lo:400:kworker.0 Request processed in 33us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830360.324555:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787830360.324566:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830360.324572:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874675316835072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.324598:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483797840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874675316835072:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830360.324603:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787830360.324635:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874675316835072:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.324646:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483796940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874675316834688:0@lo:400:kworker.0 00010000:00080000:2.0:1787830360.324656:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24837952c0 x1874675316835200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830360.325085:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874675316835200:0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.325258:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834176 00000100:00100000:1.0:1787830360.325263:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834176 00000100:00100000:1.0:1787830360.325309:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834560 00000100:00100000:1.0:1787830360.325313:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834560 00000100:00100000:1.0:1787830360.325333:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830360.325340:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483794780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316834176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.325396:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483794780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316834176:12345-0@lo:400:kworker.0 Request processed in 56us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.325402:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787830360.325415:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787830360.325422:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830360.325452:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316834560:12345-0@lo:400:kworker.0 Request processed in 31us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830360.325457:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787830360.325630:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316834048 00000100:00100000:3.0:1787830360.325635:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316834048 00000100:00100000:3.0:1787830360.325671:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787830360.325678:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316834048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830360.325751:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316834048:12345-0@lo:400:kworker.0 Request processed in 73us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830360.325758:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787830360.325794:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787830360.325799:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830360.325802:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787830360.326301:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316833920 00000100:00100000:0.0:1787830360.326306:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316833920 00000100:00100000:0.0:1787830360.326345:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787830360.326353:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:3638:x1874675316833920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830360.326414:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:3638:x1874675316833920:12345-0@lo:400:kworker.0 Request processed in 63us (6570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830360.326421:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787830360.326596:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316834048:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.326609:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483794b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316834560:0@lo:400:kworker.0 00000100:00100000:2.0:1787830360.326620:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316834176:0@lo:400:kworker.0 00000100:00100000:3.0:1787830360.328622:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b7c68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316833920:0@lo:400:kworker.0 00010000:00010000:0.0:1787830360.701034:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830360.829886:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316835328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830360.829984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830360.830168:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835328 00000100:00100000:3.0:1787830360.830177:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835328 00000100:00100000:3.0:1787830360.830239:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787830360.830250:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316835328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787830360.830286:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787830360.830343:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316835328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830360.830351:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830360.830446:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316835328:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1787830360.837860:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a02fe4e-043f-4c80-a280-961ccf82a0ae 00000001:00080000:1.0:1787830360.837880:0:24985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1787830361.340986:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830361.341012:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316835584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830361.341159:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316835456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830361.341231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830361.341254:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835584 00000100:00100000:3.0:1787830361.341261:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835584 00000100:00100000:2.0:1787830361.341299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830361.355010:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835456 00000100:00100000:3.0:1787830361.355039:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835456 00000100:00100000:3.0:1787830361.355113:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787830361.355125:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483794b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316835584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830361.355177:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787830361.355269:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483794b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316835584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (14040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830361.355276:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787830361.355292:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787830361.355298:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316835456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787830361.355317:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787830361.355355:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316835584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787830361.355368:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316835456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (14070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830361.355401:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787830361.355412:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316835456:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787830361.731159:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830362.149774:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.149951:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295741952 00000100:00100000:1.0:1787830362.149964:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295741952 00000100:00100000:1.0:1787830362.150054:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787830362.150068:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18222:x1874675295741952:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:1.0:1787830362.150123:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787830362.150230:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483796940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18222:x1874675295741952:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 164us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.150238:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00080000:3.0:1787830362.150270:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787830362.154891:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.155017:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742080 00000100:00100000:1.0:1787830362.155032:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742080 00000100:00100000:1.0:1787830362.155145:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1787830362.155158:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18222:x1874675295742080:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:1.0:1787830362.155213:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787830362.155339:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18222:x1874675295742080:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 182us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.155348:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:3.0:1787830362.155766:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830362.159848:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830362.160017:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742208 00000100:00100000:3.0:1787830362.160032:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742208 00000100:00100000:3.0:1787830362.160192:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787830362.160205:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18222:x1874675295742208:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:3.0:1787830362.160243:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787830362.160372:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18222:x1874675295742208:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 169us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830362.160381:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00080000:0.0:1787830362.160538:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830362.162633:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.162819:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742336 00000100:00100000:1.0:1787830362.162832:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742336 00000100:00100000:1.0:1787830362.162922:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787830362.162934:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:18222:x1874675295742336:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:1.0:1787830362.162978:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787830362.163293:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:18222:x1874675295742336:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 361us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.163303:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00080000:0.0:1787830362.163396:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787830362.305491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.305648:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742464 00000100:00100000:0.0:1787830362.305759:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742464 00000100:00100000:0.0:1787830362.305839:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:0.0:1787830362.305850:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+10:18256:x1874675295742464:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830362.305868:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830362.305886:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24825e3c00/0x8eaa8d1f2dfc289c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827ae6 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830362.305927:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e3c00/0x8eaa8d1f2dfc289c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827ae6 expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830362.305938:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24825e3c00/0x8eaa8d1f2dfc289c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827ae6 expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830362.305979:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3c00, rc 0) 00000100:00100000:0.0:1787830362.306051:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18256:x1874675295742464:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 203us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.306059:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:2.0:1787830362.315665:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.315891:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742592 00000100:00100000:1.0:1787830362.315906:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742592 00000100:00100000:1.0:1787830362.315991:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:1.0:1787830362.316003:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18256:x1874675295742592:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787830362.323234:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18256:x1874675295742592:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 7219us (7570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.323272:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:2.0:1787830362.325260:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.325574:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742720 00000100:00100000:0.0:1787830362.325586:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742720 00000100:00100000:0.0:1787830362.325657:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:0.0:1787830362.325671:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18256:x1874675295742720:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787830362.329332:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18256:x1874675295742720:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 3632us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.329413:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:2.0:1787830362.336187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.337547:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742848 00000100:00100000:1.0:1787830362.337568:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742848 00000100:00100000:1.0:1787830362.337666:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:1.0:1787830362.337679:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18261:x1874675295742848:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830362.340574:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18261:x1874675295742848:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 2886us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.340591:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:2.0:1787830362.362513:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.362621:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295742976 00000100:00100000:0.0:1787830362.362635:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295742976 00000100:00100000:0.0:1787830362.362710:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:0.0:1787830362.362765:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18261:x1874675295742976:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830362.363022:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18261:x1874675295742976:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 299us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.363031:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:2.0:1787830362.377190:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.377329:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743104 00000100:00100000:1.0:1787830362.377345:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743104 00000100:00100000:1.0:1787830362.377428:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:1.0:1787830362.377438:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18261:x1874675295743104:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830362.377630:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18261:x1874675295743104:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 193us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.377639:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:2.0:1787830362.385883:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.386084:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743232 00000100:00100000:0.0:1787830362.386102:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743232 00000100:00100000:0.0:1787830362.386204:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:0.0:1787830362.386216:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18256:x1874675295743232:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787830362.386237:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830362.386259:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24825e3000/0x8eaa8d1f2dfc28a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b17 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830362.386308:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e3000/0x8eaa8d1f2dfc28a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b17 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830362.386321:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24825e3000/0x8eaa8d1f2dfc28a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b17 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830362.386331:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3000, rc 0) 00000100:00100000:0.0:1787830362.386400:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18256:x1874675295743232:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 187us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.386407:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:3.0:1787830362.390854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.395463:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743360 00000100:00100000:0.0:1787830362.395475:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743360 00000100:00100000:0.0:1787830362.395873:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:0.0:1787830362.395884:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18256:x1874675295743360:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787830362.395911:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787830362.395942:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787830362.395946:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787830362.395948:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787830362.395951:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787830362.395953:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787830362.402193:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18256:x1874675295743360:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 6297us (11339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.402213:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:2.0:1787830362.405564:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.405796:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743488 00000100:00100000:1.0:1787830362.405814:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743488 00000100:00100000:1.0:1787830362.405900:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:1.0:1787830362.405909:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18256:x1874675295743488:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787830362.405938:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830362.405956:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b1e expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.405983:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.406046:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.406057:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25b7d33800, rc 0) 00000100:00100000:1.0:1787830362.406199:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18256:x1874675295743488:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 289us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.406207:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:2.0:1787830362.408559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.408779:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743616 00000100:00100000:0.0:1787830362.408791:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743616 00000100:00100000:0.0:1787830362.408849:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:0.0:1787830362.408860:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18256:x1874675295743616:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787830362.409075:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18256:x1874675295743616:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 214us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.409087:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:2.0:1787830362.411308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830362.411427:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743744 00000100:00100000:3.0:1787830362.411436:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743744 00000100:00100000:3.0:1787830362.411516:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:3.0:1787830362.411527:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18256:x1874675295743744:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787830362.411783:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18256:x1874675295743744:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 256us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830362.411792:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:2.0:1787830362.423247:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.423499:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295743872 00000100:00100000:1.0:1787830362.423512:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295743872 00000100:00100000:1.0:1787830362.423574:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:1.0:1787830362.423585:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18264:x1874675295743872:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787830362.423806:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18264:x1874675295743872:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 222us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.423815:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:2.0:1787830362.436649:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.436881:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744000 00000100:00100000:0.0:1787830362.436892:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744000 00000100:00100000:0.0:1787830362.436949:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:0.0:1787830362.436959:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18264:x1874675295744000:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787830362.437127:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18264:x1874675295744000:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 168us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.437146:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:2.0:1787830362.444309:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830362.444359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830362.444461:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744128 00000100:00100000:3.0:1787830362.444472:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744128 00000100:00100000:3.0:1787830362.444521:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744384 00000100:00100000:3.0:1787830362.444524:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744384 00000100:00100000:3.0:1787830362.444545:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787830362.444552:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2391:x1874675295744128:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787830362.444583:0:24451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dccc238e-e1d7-4d48-8c0b-2d5716f85f4d@192.168.204.30@tcp t0 exp 0000000000000000 cur 751 last 0 00000020:00000080:3.0:1787830362.444635:0:24451:0:(genops.c:1385:class_connect()) connect: client dccc238e-e1d7-4d48-8c0b-2d5716f85f4d, cookie 0x8eaa8d1f2dfc28b1 00000004:00100000:3.0:1787830362.444661:0:24451:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787830362.444796:0:24451:0:(import.c:65:import_set_state_nolock()) ffff9f248255e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830362.444860:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2391:x1874675295744128:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 308us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830362.444868:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787830362.444884:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:3.0:1787830362.444888:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2391:x1874675295744384:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787830362.444902:0:24451:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from dccc238e-e1d7-4d48-8c0b-2d5716f85f4d@192.168.204.30@tcp t0 exp 0000000000000000 cur 751 last 0 00000020:00000080:3.0:1787830362.444924:0:24451:0:(genops.c:1385:class_connect()) connect: client dccc238e-e1d7-4d48-8c0b-2d5716f85f4d, cookie 0x8eaa8d1f2dfc28b8 00000004:00100000:3.0:1787830362.444936:0:24451:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787830362.445008:0:24451:0:(import.c:65:import_set_state_nolock()) ffff9f248255b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787830362.445033:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2391:x1874675295744384:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 143us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830362.445040:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1787830362.459565:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830362.459605:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830362.459789:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.470964:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744512 00000100:00100000:0.0:1787830362.470983:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744512 00000100:00100000:0.0:1787830362.471071:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744256 00000100:00100000:0.0:1787830362.471075:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744256 00000100:00100000:0.0:1787830362.471090:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744640 00000100:00100000:0.0:1787830362.471093:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744640 00000100:00100000:0.0:1787830362.471113:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1787830362.471122:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:0:x1874675295744512:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787830362.471153:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830362.471241:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:0:x1874675295744512:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 119us (11690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.471250:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1787830362.471270:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787830362.471277:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+7:0:x1874675295744256:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787830362.471290:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787830362.471381:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+7:0:x1874675295744256:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 104us (11775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.471388:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787830362.471402:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1787830362.471408:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295744640:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787830362.471421:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787830362.471442:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295744640:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 34us (11653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.471464:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00080000:2.0:1787830362.471699:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787830362.471704:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787830362.484211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.484300:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744768 00000100:00100000:0.0:1787830362.484312:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744768 00000100:00100000:0.0:1787830362.484379:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787830362.484390:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295744768:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787830362.484506:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295744768:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830362.484514:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787830362.495152:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.495191:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830362.495225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.495308:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295744896 00000100:00100000:1.0:1787830362.495317:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295744896 00000100:00100000:1.0:1787830362.495359:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745024 00000100:00100000:1.0:1787830362.495362:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745024 00000100:00100000:1.0:1787830362.495378:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1787830362.495386:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1874675295744896:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787830362.495423:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dccc238e-e1d7-4d48-8c0b-2d5716f85f4d@192.168.204.30@tcp t0 exp 0000000000000000 cur 751 last 0 00000020:00000080:1.0:1787830362.495460:0:24167:0:(genops.c:1385:class_connect()) connect: client dccc238e-e1d7-4d48-8c0b-2d5716f85f4d, cookie 0x8eaa8d1f2dfc28bf 00002000:00100000:1.0:1787830362.495471:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dccc238e-e1d7-4d48-8c0b-2d5716f85f4d/ffff9f25b867c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787830362.495482:0:24167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787830362.495559:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787830362.495601:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9f25b867e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830362.495666:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2391:x1874675295744896:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 279us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.495675:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1787830362.495704:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1787830362.495709:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1874675295745024:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787830362.495749:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dccc238e-e1d7-4d48-8c0b-2d5716f85f4d@192.168.204.30@tcp t0 exp 0000000000000000 cur 751 last 0 00000020:00000080:1.0:1787830362.495766:0:24167:0:(genops.c:1385:class_connect()) connect: client dccc238e-e1d7-4d48-8c0b-2d5716f85f4d, cookie 0x8eaa8d1f2dfc28c6 00002000:00100000:1.0:1787830362.495772:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dccc238e-e1d7-4d48-8c0b-2d5716f85f4d/ffff9f25b867f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787830362.495778:0:24167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787830362.495841:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787830362.495857:0:24167:0:(import.c:65:import_set_state_nolock()) ffff9f25b8679800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787830362.495880:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2391:x1874675295745024:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 169us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.495887:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:2.0:1787830362.496081:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745152 00000100:00100000:2.0:1787830362.496086:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745152 00000100:00100000:2.0:1787830362.496127:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787830362.496136:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295745152:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787830362.496173:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295745152:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 39us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830362.496180:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1787830362.498935:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830362.499039:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745280 00000100:00100000:3.0:1787830362.499051:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745280 00000100:00100000:3.0:1787830362.499110:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:3.0:1787830362.499120:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295745280:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787830362.499215:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787830362.499343:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18256:x1874675295745280:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 223us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830362.499351:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1787830362.728525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830362.728645:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745408 00000100:00100000:1.0:1787830362.728657:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745408 00000100:00100000:1.0:1787830362.728722:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1787830362.728765:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18287:x1874675295745408:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:1.0:1787830362.728788:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830362.728810:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32a00/0x8eaa8d1f2dfc28cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b4f expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.728880:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.728910:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.728924:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830362.728975:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787830362.728979:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830362.729000:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.729030:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32a00/0x8eaa8d1f2dfc28cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.729049:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830362.729058:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:1.0:1787830362.729061:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787830362.729065:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25b7d32200, rc 0) 00000100:00100000:1.0:1787830362.729135:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+7:18287:x1874675295745408:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 372us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830362.729143:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00010000:00010000:3.0:1787830362.749470:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830363.776575:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830363.902039:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787830363.902071:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316835712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830363.902152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830363.902239:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835712 00000100:00100000:0.0:1787830363.902247:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835712 00000100:00100000:0.0:1787830363.902309:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787830363.902318:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316835712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830363.902356:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830363.902409:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316835712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830363.902432:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787830363.903051:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830363.903096:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316835712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787830364.797562:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830365.437172:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f248379a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316835840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830365.437307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830365.437415:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835840 00000100:00100000:2.0:1787830365.437423:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835840 00000100:00100000:2.0:1787830365.437666:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830365.437679:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483799a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316835840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830365.437710:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787830365.437933:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483799a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316835840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830365.437941:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830365.437968:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316835968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830365.438001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830365.438105:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787830365.438122:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316835968 00000100:00100000:0.0:1787830365.438126:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316835968 00000100:00100000:2.0:1787830365.438131:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f248379a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316835840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787830365.438160:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787830365.438168:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316835968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787830365.438179:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1787830365.438206:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787830365.438214:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316835968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.438444:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830365.438455:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316836096:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.438540:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836096 00000100:00100000:3.0:1787830365.438544:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836096 00000100:00100000:3.0:1787830365.438574:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787830365.438594:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:3640:x1874675316836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438633:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:3640:x1874675316836096:12345-0@lo:400:kworker.0 Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.438639:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787830365.438674:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316836096:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438705:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316836224:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.438776:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836224 00000100:00100000:3.0:1787830365.438779:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836224 00000100:00100000:3.0:1787830365.438816:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787830365.438823:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316836224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438859:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316836224:12345-0@lo:400:kworker.0 Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.438864:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787830365.438890:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316836224:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438938:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830365.438943:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316836608:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.438965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.438989:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836608 00000100:00100000:3.0:1787830365.438993:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836608 00000100:00100000:3.0:1787830365.439014:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787830365.439020:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316836608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439053:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316836608:12345-0@lo:400:kworker.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.439059:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787830365.439082:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316836608:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439112:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316836736:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439166:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836736 00000100:00100000:3.0:1787830365.439170:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836736 00000100:00100000:3.0:1787830365.439206:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787830365.439213:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316836736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439248:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316836736:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.439255:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787830365.439268:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830365.439299:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316836736:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439335:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787830365.439342:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874675316837120:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439368:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439421:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837120 00000100:00100000:3.0:1787830365.439425:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837120 00000100:00100000:3.0:1787830365.439460:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787830365.439466:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874675316837120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439501:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874675316837120:12345-0@lo:400:kworker.0 Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.439506:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787830365.439524:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787830365.439542:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25b67d9680 x1874675316837120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830365.439553:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874675316837120:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439583:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874675316837248:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439636:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837248 00000100:00100000:3.0:1787830365.439639:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837248 00000100:00100000:3.0:1787830365.439665:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787830365.439672:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874675316837248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439705:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874675316837248:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.439711:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787830365.439747:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787830365.439764:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874675316837248:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439813:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316836352:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439854:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316836864:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439906:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316837376:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439942:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787830365.439947:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316836480:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.439968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.439982:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316836992:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830365.440025:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836864 00000100:00100000:3.0:1787830365.440029:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836864 00000100:00100000:3.0:1787830365.440062:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837376 00000100:00100000:3.0:1787830365.440067:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837376 00000100:00100000:3.0:1787830365.440087:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836480 00000100:00100000:3.0:1787830365.440090:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836480 00000100:00100000:3.0:1787830365.440098:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836992 00000100:00100000:3.0:1787830365.440100:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836992 00000100:00100000:3.0:1787830365.440113:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830365.440118:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316836864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440153:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874675316836864:12345-0@lo:400:kworker.0 Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.440160:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787830365.440170:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830365.440176:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316837376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440202:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874675316837376:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.440207:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787830365.440218:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787830365.440230:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316836480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440274:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874675316836480:12345-0@lo:400:kworker.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.440280:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787830365.440292:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787830365.440298:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316836992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440324:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874675316836992:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.440329:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787830365.440367:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316835968:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787830365.440387:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830365.440404:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787830365.440425:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874675316836480:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440433:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874675316836992:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440441:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874675316836864:0@lo:400:kworker.0 00010000:00080000:3.0:1787830365.440450:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f25b67d9680 x1874675316837376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830365.440459:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874675316837376:0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440490:0:25270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316836352 00000100:00100000:3.0:1787830365.440494:0:25270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316836352 00000100:00100000:3.0:1787830365.440525:0:25270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787830365.440531:0:25270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316836352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830365.440564:0:25270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316836352:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830365.440580:0:25270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787830365.440599:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787830365.440617:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316836352:0@lo:400:kworker.0 00000100:00100000:0.0:1787830365.443437:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787830365.822296:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830365.954790:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787830365.954822:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f248379a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316837504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787830365.954895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830365.954945:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837504 00000100:00100000:2.0:1787830365.954953:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837504 00000100:00100000:2.0:1787830365.955001:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830365.955012:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316837504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830365.955045:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787830365.955096:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316837504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830365.955103:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830365.955149:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f248379a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316837504:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787830365.962993:0:23393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dccc238e-e1d7-4d48-8c0b-2d5716f85f4d 00000001:00100000:0.0:1787830365.963015:0:23393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9a02fe4e-043f-4c80-a280-961ccf82a0ae 00000001:00100000:0.0:1787830365.964871:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dccc238e-e1d7-4d48-8c0b-2d5716f85f4d 00000001:00100000:0.0:1787830365.964887:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a02fe4e-043f-4c80-a280-961ccf82a0ae 00000001:00100000:1.0:1787830365.965895:0:22641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dccc238e-e1d7-4d48-8c0b-2d5716f85f4d 00000001:00100000:1.0:1787830365.965907:0:22641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9a02fe4e-043f-4c80-a280-961ccf82a0ae 00000001:02000400:2.0:1787830366.029647:0:25541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787830366.462547:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787830366.462590:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316837632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830366.462703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830366.462921:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837632 00000100:00100000:0.0:1787830366.462935:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837632 00000100:00100000:0.0:1787830366.464837:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787830366.464869:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316837632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830366.464937:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830366.465432:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316837632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 515us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830366.465443:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787830366.466969:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316837632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830366.468609:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316837760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830366.468767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830366.468919:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837760 00000100:00100000:3.0:1787830366.468930:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837760 00000100:00100000:3.0:1787830366.469009:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787830366.469020:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316837760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830366.469079:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787830366.469141:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316837760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830366.469149:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787830366.469675:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316837760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830366.845137:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787830367.618379:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787830367.869639:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830367.914696:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914785:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914807:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914823:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914850:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914873:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914894:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914940:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830367.914999:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745536 00000100:00100000:1.0:1787830367.915014:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745536 00000100:00100000:1.0:1787830367.915092:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:1.0:1787830367.915105:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2394:x1874675295745536:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830367.915208:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2394:x1874675295745536:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830367.915217:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:1.0:1787830367.915257:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745920 00000100:00100000:1.0:1787830367.915260:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745920 00000100:00100000:1.0:1787830367.915293:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746432 00000100:00100000:1.0:1787830367.915296:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746432 00000100:00100000:1.0:1787830367.915309:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746048 00000100:00100000:1.0:1787830367.915311:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746048 00000100:00100000:1.0:1787830367.915326:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746560 00000100:00100000:1.0:1787830367.915328:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746560 00000100:00100000:1.0:1787830367.915355:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:1.0:1787830367.915362:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295745920:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830367.915396:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295745920:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830367.915403:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:1.0:1787830367.915425:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787830367.915432:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2394:x1874675295746432:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830367.915459:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2394:x1874675295746432:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830367.915465:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787830367.915476:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787830367.915482:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295746048:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830367.915508:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295746048:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830367.915514:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787830367.915525:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787830367.915531:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2394:x1874675295746560:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787830367.915555:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2394:x1874675295746560:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830367.915562:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1787830367.917089:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745664 00000100:00100000:3.0:1787830367.917102:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745664 00000100:00100000:3.0:1787830367.917160:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746176 00000100:00100000:3.0:1787830367.917164:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746176 00000100:00100000:3.0:1787830367.917181:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295745792 00000100:00100000:3.0:1787830367.917184:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295745792 00000100:00100000:3.0:1787830367.917196:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746304 00000100:00100000:3.0:1787830367.917199:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746304 00000100:00100000:3.0:1787830367.917221:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787830367.917232:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2394:x1874675295745664:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830367.917318:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2394:x1874675295745664:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 88us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830367.917326:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787830367.917353:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:3.0:1787830367.917360:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2394:x1874675295746176:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830367.917395:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2394:x1874675295746176:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830367.917402:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:3.0:1787830367.917413:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1787830367.917419:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295745792:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830367.917442:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295745792:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830367.917447:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1787830367.917458:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:3.0:1787830367.917464:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b60130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2394:x1874675295746304:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830367.917583:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b60130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2394:x1874675295746304:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 119us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830367.917590:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00080000:3.0:1787830367.917644:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787830367.917649:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830367.917652:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830367.917656:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787830368.513604:0:24985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dccc238e-e1d7-4d48-8c0b-2d5716f85f4d 00010000:00010000:3.0:1787830368.893784:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830369.021225:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787830369.021251:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316837888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830369.021319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830369.021407:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316837888 00000100:00100000:0.0:1787830369.021417:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316837888 00000100:00100000:0.0:1787830369.021478:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830369.021496:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316837888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830369.021527:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830369.021575:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316837888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830369.021582:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787830369.021632:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316837888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787830369.021789:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787830369.918769:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787830370.366709:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787830370.563499:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316838016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787830370.563575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.563635:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316838528:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.563667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.563692:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316839040:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.563713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.563746:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874675316839552:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.563771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.563796:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787830370.563802:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316838400:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.563822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.563839:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.563860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.563877:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316839424:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.563896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.565571:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316838144:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.565635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830370.565676:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316838656:0@lo:400:kworker.0 00000100:00100000:3.0:1787830370.565711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830370.565802:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838144 00000100:00100000:0.0:1787830370.565811:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838144 00000100:00100000:0.0:1787830370.565888:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787830370.565898:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:3639:x1874675316838144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787830370.565951:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:3639:x1874675316838144:12345-0@lo:400:kworker.0 Request processed in 54us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830370.565958:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787830370.568386:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838528 00000100:00100000:2.0:1787830370.568402:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838528 00000100:00100000:2.0:1787830370.568459:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839040 00000100:00100000:2.0:1787830370.568463:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839040 00000100:00100000:2.0:1787830370.568477:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838400 00000100:00100000:2.0:1787830370.568480:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838400 00000100:00100000:2.0:1787830370.568490:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838912 00000100:00100000:2.0:1787830370.568493:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838912 00000100:00100000:2.0:1787830370.568511:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787830370.568519:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b055fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316838528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.568618:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b055fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316838528:12345-0@lo:400:kworker.0 Request processed in 99us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.568625:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787830370.568835:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830370.568843:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316839040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.568875:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316839040:12345-0@lo:400:kworker.0 Request processed in 33us (5161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.568881:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787830370.568893:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787830370.568899:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316838400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.568926:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316838400:12345-0@lo:400:kworker.0 Request processed in 28us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.568932:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787830370.568943:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830370.568949:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.569008:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316838912:12345-0@lo:400:kworker.0 Request processed in 59us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.569015:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787830370.569042:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838016 00000100:00100000:2.0:1787830370.569047:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838016 00000100:00100000:2.0:1787830370.569082:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787830370.569089:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316838016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787830370.569111:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787830370.569382:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316838016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 293us (5806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.569389:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787830370.569416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316838272:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.569452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.569479:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316838784:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.569499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.569524:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874675316839296:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.569553:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838272 00000100:00100000:2.0:1787830370.569557:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838272 00000100:00100000:2.0:1787830370.569585:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838784 00000100:00100000:2.0:1787830370.569588:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838784 00000100:00100000:2.0:1787830370.569602:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830370.569608:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316838272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.569646:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316838272:12345-0@lo:400:kworker.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.569652:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830370.569665:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830370.569689:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316838784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.569719:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316838784:12345-0@lo:400:kworker.0 Request processed in 42us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.569752:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830370.570273:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839552 00000100:00100000:2.0:1787830370.570278:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839552 00000100:00100000:2.0:1787830370.570324:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839424 00000100:00100000:2.0:1787830370.570327:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839424 00000100:00100000:2.0:1787830370.570342:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316838656 00000100:00100000:2.0:1787830370.570345:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316838656 00000100:00100000:2.0:1787830370.570385:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787830370.570392:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874675316839552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.570434:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874675316839552:12345-0@lo:400:kworker.0 Request processed in 43us (6662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.570440:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787830370.570453:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830370.570459:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874675316839424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.570487:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874675316839424:12345-0@lo:400:kworker.0 Request processed in 29us (6590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.570493:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787830370.570503:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830370.570508:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316838656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.570537:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874675316838656:12345-0@lo:400:kworker.0 Request processed in 29us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.570543:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787830370.570591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.570613:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6010f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316839808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830370.570651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.570705:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316838272:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.570718:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316838784:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.570769:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839808 00000100:00100000:2.0:1787830370.570772:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839808 00000100:00100000:2.0:1787830370.570791:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830370.570797:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316839808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787830370.570810:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787830370.570842:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316839808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.570848:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787830370.570879:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6010f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316839808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830370.570898:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839296 00000100:00100000:2.0:1787830370.570901:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839296 00000100:00100000:2.0:1787830370.570924:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830370.570931:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874675316839296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.570964:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874675316839296:12345-0@lo:400:kworker.0 Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.570970:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787830370.571242:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874675316839296:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571271:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316838400:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571284:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316838912:0@lo:400:kworker.0 00010000:00080000:2.0:1787830370.571308:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24833aa580 x1874675316839424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830370.571334:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874675316839424:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571355:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316838016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830370.571366:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316838528:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571375:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316839040:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571385:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874675316839552:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571423:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874675316838656:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571770:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874675316839168:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.571835:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839168 00000100:00100000:2.0:1787830370.571840:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839168 00000100:00100000:2.0:1787830370.571868:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830370.571875:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483798780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874675316839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571906:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483798780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874675316839168:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.571913:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787830370.571942:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874675316839168:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571948:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316839680:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.571969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.572251:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316839680 00000100:00100000:2.0:1787830370.572255:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316839680 00000100:00100000:2.0:1787830370.572282:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787830370.572288:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483798b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874675316839680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.572340:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483798b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874675316839680:12345-0@lo:400:kworker.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.572347:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1787830370.572375:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f24833aa1c0 x1874675316839680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830370.572386:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874675316839680:0@lo:400:kworker.0 00000100:00100000:2.0:1787830370.572411:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316838144:0@lo:400:kworker.0 00000100:00080000:1.0:1787830370.581849:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830370.581926:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830370.581930:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830370.581934:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1787830370.686770:0:25689:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecb48e390 20000000:00000080:2.0:1787830370.686791:0:25689:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f248224d000 uarg=0000000000000000 20000000:01000000:2.0:1787830370.686833:0:25689:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787830370.686840:0:25689:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787830370.686845:0:25689:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787830370.688406:0:25690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787830370.688617:0:25689:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787830370.699388:0:25689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787830370.703340:0:25689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703371:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703380:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703388:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703395:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703422:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703430:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703437:0:25689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703488:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703505:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 12 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.703522:0:25689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316839936:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787830370.703690:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703698:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.703707:0:25689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840064:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787830370.703786:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703795:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 23 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.703817:0:25689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840192:0@lo:104: 00000100:00100000:0.0:1787830370.703860:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830370.703897:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703905:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 23 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.703927:0:25689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840320:0@lo:104: 00000100:00100000:0.0:1787830370.703950:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787830370.703988:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.703997:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 23 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.704006:0:25689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840448:0@lo:104: 00000100:00100000:0.0:1787830370.704027:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830370.704058:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840192 00000100:00100000:0.0:1787830370.704065:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840192 00000100:00100000:0.0:1787830370.704102:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840320 00000100:00100000:0.0:1787830370.704106:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840320 00000100:00100000:0.0:1787830370.704128:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840448 00000100:00100000:0.0:1787830370.704131:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840448 00000100:00100000:0.0:1787830370.704147:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787830370.704155:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+5:25689:x1874675316840192:12345-0@lo:104: 00010000:00010000:0.0:1787830370.704169:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704367:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830370.704374:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+5:25689:x1874675316840192:12345-0@lo:104: Request processed in 219us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830370.704382:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787830370.704401:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830370.704407:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+4:25689:x1874675316840320:12345-0@lo:104: 00010000:00010000:0.0:1787830370.704415:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704446:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787830370.704451:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+4:25689:x1874675316840320:12345-0@lo:104: Request processed in 45us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830370.704457:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787830370.704468:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787830370.704474:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+3:25689:x1874675316840448:12345-0@lo:104: 00010000:00010000:0.0:1787830370.704481:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704512:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787830370.704517:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+3:25689:x1874675316840448:12345-0@lo:104: Request processed in 44us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830370.704523:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787830370.704540:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787830370.704546:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704564:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8000 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830370.704568:0:24673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704577:0:24673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830370.704585:0:24673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830370.704591:0:24673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830370.704626:0:24673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704633:0:24673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830370.704652:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704658:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25906c8000/0x8eaa8d1f2dfc26ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2706 expref: -99 pid: 24984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704672:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787830370.704675:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704680:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9800 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830370.704682:0:24673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704698:0:24673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830370.704704:0:24673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830370.704708:0:24673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830370.704755:0:24673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704762:0:24673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830370.704768:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704774:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25906c9800/0x8eaa8d1f2dfc257e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2585 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704783:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830370.704787:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704792:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25bd1ba200 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830370.704795:0:24673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704801:0:24673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830370.704808:0:24673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830370.704819:0:24673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787830370.704832:0:24673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704838:0:24673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830370.704851:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704858:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f25bd1ba200/0x8eaa8d1f2dfc253f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2546 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704867:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830370.704869:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830370.704871:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830370.704901:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.704911:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 23 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.704921:0:25689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483795680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840960:0@lo:104: 00000100:00100000:0.0:1787830370.704949:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830370.704972:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840960 00000100:00100000:0.0:1787830370.704976:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840960 00000100:00100000:0.0:1787830370.704995:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830370.705000:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+3:25689:x1874675316840960:12345-0@lo:104: 00010000:00010000:0.0:1787830370.705008:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.705051:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787830370.705056:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f65c475-02cd-4018-98b1-85148034a57b+3:25689:x1874675316840960:12345-0@lo:104: Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830370.705063:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787830370.705077:0:24673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830370.705081:0:24673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.705087:0:24673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2580030600 already unused, calling callback (ffffffffc125ec20) 10000000:00010000:0.0:1787830370.705090:0:24673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.705097:0:24673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787830370.705103:0:24673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787830370.705109:0:24673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787830370.705529:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830370.705544:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316840704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830370.705581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.705624:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787830370.705630:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316840576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830370.705651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.705687:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483794780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316840832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830370.705711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830370.705767:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840704 00000100:00100000:2.0:1787830370.705772:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840704 00010000:00010000:2.0:1787830370.705793:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 24 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830370.705829:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840576 00000100:00100000:2.0:1787830370.705832:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840576 00010000:00010000:2.0:1787830370.705844:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 25 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830370.705854:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316840832 00000100:00100000:2.0:1787830370.705856:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316840832 00010000:00010000:2.0:1787830370.705865:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 26 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830370.705876:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830370.705882:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+26:3638:x1874675316840704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830370.705892:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830370.705896:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 26 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.705905:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 26 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.705933:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830370.705962:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+26:3638:x1874675316840704:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.705979:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787830370.705995:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830370.706000:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+25:3638:x1874675316840576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830370.706010:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830370.706014:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 25 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.706033:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 25 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.706043:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830370.706066:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+25:3638:x1874675316840576:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.706072:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787830370.706084:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830370.706090:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483799e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+24:3639:x1874675316840832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787830370.706100:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830370.706104:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 24 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.706111:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 24 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.706310:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830370.706341:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483799e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+24:3639:x1874675316840832:12345-0@lo:103:ldlm_bl.0 Request processed in 251us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.706348:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787830370.706397:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483794780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f65c475-02cd-4018-98b1-85148034a57b:3639:1874675316840832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830370.706427:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316840576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830370.706434:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483796d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316840704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830370.706648:0:24673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.706656:0:24673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787830370.706688:0:24673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.706695:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f2580030600/0x8eaa8d1f2dfc2531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8eaa8d1f2dfc2538 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.706740:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830370.706743:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830370.706745:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787830370.706768:0:25689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483522240 going to sleep for 11 seconds 00010000:00010000:0.0:1787830370.706785:0:25689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25814b3e00/0x8eaa8d1f2dfc2706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc26ff expref: 23 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.706795:0:25689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840192:0@lo:104: 00010000:00010000:0.0:1787830370.706805:0:25689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21d0400/0x8eaa8d1f2dfc2585 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc257e expref: 22 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.706813:0:25689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840320:0@lo:104: 00010000:00010000:0.0:1787830370.706822:0:25689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2580030000/0x8eaa8d1f2dfc2546 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc253f expref: 21 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.706829:0:25689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840448:0@lo:104: 00000100:00100000:0.0:1787830370.706835:0:25689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483795680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840960:0@lo:104: 00010000:00010000:3.0:1787830370.706933:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830370.707462:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316841088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787830370.707514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830370.707644:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841088 00000100:00100000:0.0:1787830370.707651:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841088 00010000:00010000:0.0:1787830370.707820:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 21 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.707854:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787830370.707866:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483799680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+21:3640:x1874675316841088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787830370.707877:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830370.707883:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 21 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.707903:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 21 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.708262:0:23413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25c21d1a00/0x8eaa8d1f2dfc2538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8eaa8d1f2dfc2531 expref: 21 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.708276:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830370.708409:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483799680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f65c475-02cd-4018-98b1-85148034a57b+20:3640:x1874675316841088:12345-0@lo:103:ldlm_bl.0 Request processed in 544us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830370.708461:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f65c475-02cd-4018-98b1-85148034a57b:3640:1874675316841088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787830370.708491:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787830370.712696:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830370.712879:0:25689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316839936:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787830370.712891:0:25689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1874675316840064:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787830370.712944:0:25689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830370.713073:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746688 00000100:00100000:2.0:1787830370.713081:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746688 00010000:00010000:2.0:1787830370.713128:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 13 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830370.713175:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1787830370.713184:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2395:x1874675295746688:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830370.713302:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830370.713310:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 13 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.713323:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 13 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.713345:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25b7d33800/0x8eaa8d1f2dfc28aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b1e expref: 13 pid: 22655 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.713359:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830370.713420:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:2395:x1874675295746688:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 237us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830370.713428:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787830370.717020:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830370.717183:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746816 00000100:00100000:0.0:1787830370.717194:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746816 00010000:00010000:0.0:1787830370.717252:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830370.717675:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1787830370.717687:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:2394:x1874675295746816:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830370.717706:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830370.717713:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718107:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718148:0:23413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f25906c8a00/0x8eaa8d1f2dfc286b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827aae expref: 12 pid: 22656 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718168:0:23413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718177:0:23413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718196:0:23413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718202:0:23413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718209:0:23413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718229:0:23413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718235:0:23413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830370.718243:0:23413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718251:0:23413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718274:0:23413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830370.718310:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830370.718372:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:2394:x1874675295746816:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 688us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830370.718381:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00010000:00010000:2.0:1787830370.719017:0:25689:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.719028:0:25689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.719035:0:25689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f24825e2c00/0x8eaa8d1f2dfc28db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830370.941716:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830371.069087:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f248379b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316841216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830371.069160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830371.069739:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841216 00000100:00100000:2.0:1787830371.069749:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841216 00000100:00100000:2.0:1787830371.069806:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787830371.069816:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316841216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787830371.069849:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787830371.069917:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316841216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830371.069924:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787830371.070107:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f248379b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316841216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830371.581211:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787830371.581234:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316841344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787830371.581335:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830371.581438:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841344 00000100:00100000:3.0:1787830371.581447:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841344 00000100:00100000:3.0:1787830371.581506:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787830371.581516:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b60112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316841344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787830371.581561:0:23622:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787830371.581611:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b60112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874675316841344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830371.581619:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787830371.581709:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874675316841344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830371.581991:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316841472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830371.582026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830371.582106:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841472 00000100:00100000:0.0:1787830371.582111:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841472 00000100:00100000:0.0:1787830371.582146:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787830371.582155:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316841472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830371.582176:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830371.582223:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316841472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830371.582230:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787830371.582311:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316841472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830371.818452:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830371.818609:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295746944 00000100:00100000:3.0:1787830371.818620:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295746944 00000100:00100000:3.0:1787830371.818703:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:3.0:1787830371.818714:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+11:18137:x1874675295746944:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787830371.818763:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830371.818783:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2482124a00/0x8eaa8d1f2dfc28e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b56 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830371.818816:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2482124a00/0x8eaa8d1f2dfc28e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b56 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830371.818828:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2482124a00/0x8eaa8d1f2dfc28e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b56 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830371.818839:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482124a00, rc 0) 00000100:00100000:3.0:1787830371.818912:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18137:x1874675295746944:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 199us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830371.818920:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:1.0:1787830371.824181:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830371.824327:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747072 00000100:00100000:0.0:1787830371.824338:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747072 00000100:00100000:0.0:1787830371.824399:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:0.0:1787830371.824410:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18137:x1874675295747072:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830371.833193:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18137:x1874675295747072:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 8771us (9009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830371.833221:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:2.0:1787830371.843177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830371.843417:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747200 00000100:00100000:0.0:1787830371.843428:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747200 00000100:00100000:0.0:1787830371.843490:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:0.0:1787830371.843501:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18137:x1874675295747200:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830371.856927:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18137:x1874675295747200:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 13414us (13747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830371.856945:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:2.0:1787830371.866088:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830371.866483:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747328 00000100:00100000:0.0:1787830371.866495:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747328 00000100:00100000:0.0:1787830371.866552:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:0.0:1787830371.866563:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+12:18137:x1874675295747328:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830371.866579:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830371.866597:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24825e3a00/0x8eaa8d1f2dfc28e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b5d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830371.866627:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e3a00/0x8eaa8d1f2dfc28e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b5d expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830371.866639:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24825e3a00/0x8eaa8d1f2dfc28e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b5d expref: 13 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830371.866649:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3a00, rc 0) 00000100:00100000:0.0:1787830371.866705:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18137:x1874675295747328:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 144us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830371.866712:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:1.0:1787830371.871015:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830371.871513:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747456 00000100:00100000:3.0:1787830371.871524:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747456 00000100:00100000:3.0:1787830371.871585:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:3.0:1787830371.871594:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18137:x1874675295747456:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830371.871795:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18137:x1874675295747456:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 201us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830371.871819:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:2.0:1787830371.884424:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830371.884569:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747584 00000100:00100000:3.0:1787830371.884581:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747584 00000100:00100000:3.0:1787830371.884644:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:3.0:1787830371.884655:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18137:x1874675295747584:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830371.885477:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:18137:x1874675295747584:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 819us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830371.885488:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 156 00010000:00010000:0.0:1787830371.965058:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787830372.157246:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787830372.157257:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f258971f800 from 13 10000000:01000000:0.0:1787830372.157279:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787830372.157338:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.157373:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.157386:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830372.157419:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787830372.157514:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830372.157566:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bb6866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787830372.157805:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841600 00000100:00100000:1.0:1787830372.157814:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841600 00000100:00100000:1.0:1787830372.157867:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787830372.157876:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+20:22658:x1874675316841600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830372.157891:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830372.157905:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25b7d33c00/0x8eaa8d1f2dfc28f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc28f0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.157935:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25b7d33c00/0x8eaa8d1f2dfc28f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc28f0 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.157947:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25b7d33c00/0x8eaa8d1f2dfc28f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc28f0 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.157956:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25b7d33c00, rc 0) 00000100:00100000:1.0:1787830372.158018:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316841600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830372.158024:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787830372.158143:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830372.158158:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc28f7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.158168:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc28f7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.158230:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.158258:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830372.158296:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830372.158780:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841728 00000100:00100000:3.0:1787830372.158785:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841728 00000100:00100000:3.0:1787830372.158828:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787830372.158837:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316841728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830372.158966:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316841728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830372.158974:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787830372.160512:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.160574:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.160646:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830372.160693:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235180 going to sleep for 11 seconds 00000100:00100000:3.0:1787830372.161593:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841856 00000100:00100000:3.0:1787830372.161602:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841856 00000100:00100000:3.0:1787830372.161666:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787830372.161676:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316841856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.165361:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316841856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3676us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.165378:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787830372.166170:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787830372.169429:0:25702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787830372.169792:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787830372.169819:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830372.169831:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc28f7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.169844:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f24825e3600/0x8eaa8d1f2dfc28f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc28f7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830372.169854:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830372.169857:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f248233c000 from 13 10000000:01000000:2.0:1787830372.169860:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830372.169899:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.169907:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.169920:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.169946:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.170018:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830372.170078:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235780 going to sleep for 11 seconds 00000100:00100000:0.0:1787830372.170302:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316841984 00000100:00100000:0.0:1787830372.170310:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316841984 00000100:00100000:0.0:1787830372.170367:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787830372.170376:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+21:22658:x1874675316841984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830372.170390:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.170404:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f24825e2400/0x8eaa8d1f2dfc2905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc28fe expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.170430:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f24825e2400/0x8eaa8d1f2dfc2905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc28fe expref: 22 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.170947:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f24825e2400/0x8eaa8d1f2dfc2905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc28fe expref: 22 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.170958:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2400, rc 0) 00000100:00100000:0.0:1787830372.171019:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316841984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 644us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830372.171037:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787830372.171175:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316841984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830372.171192:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2905 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.171202:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2905 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.171278:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.171309:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830372.171345:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235780 going to sleep for 11 seconds 00000100:00100000:3.0:1787830372.172876:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842112 00000100:00100000:3.0:1787830372.172889:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842112 00000100:00100000:3.0:1787830372.172956:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787830372.172965:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316842112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787830372.173136:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316842112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830372.173163:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787830372.173291:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.173350:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.173399:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830372.173450:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830372.173529:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842240 00000100:00100000:1.0:1787830372.173535:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842240 00000100:00100000:1.0:1787830372.173572:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787830372.173580:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b03b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316842240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830372.173679:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b03b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316842240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830372.173686:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787830372.173990:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787830372.175358:0:25703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787830372.175602:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787830372.175628:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787830372.175639:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2905 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.175650:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9c00/0x8eaa8d1f2dfc28fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2905 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787830372.175661:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787830372.175664:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f25896b5800 from 13 10000000:01000000:2.0:1787830372.175667:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787830372.175707:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.175715:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.175767:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.175791:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.175846:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830372.175883:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235780 going to sleep for 11 seconds 00000100:00100000:1.0:1787830372.176001:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842368 00000100:00100000:1.0:1787830372.176008:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842368 00000100:00100000:1.0:1787830372.176056:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787830372.176065:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+22:22658:x1874675316842368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830372.176076:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830372.176088:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25b7d32400/0x8eaa8d1f2dfc2913 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc290c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.176111:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25b7d32400/0x8eaa8d1f2dfc2913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc290c expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.176122:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25b7d32400/0x8eaa8d1f2dfc2913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc290c expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.176130:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25b7d32400, rc 0) 00000100:00100000:1.0:1787830372.176176:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316842368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830372.176183:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787830372.176270:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787830372.176284:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2913 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.176292:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2913 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830372.176345:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830372.176370:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830372.176399:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830372.176803:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842496 00000100:00100000:1.0:1787830372.176808:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842496 00000100:00100000:1.0:1787830372.176843:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787830372.176850:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316842496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830372.176959:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316842496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830372.176982:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787830372.177057:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787830372.177087:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830372.177130:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830372.177158:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830372.177171:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842624 00000100:00100000:0.0:1787830372.177175:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842624 00000100:00100000:0.0:1787830372.177195:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787830372.177200:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316842624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787830372.177301:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316842624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830372.177308:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787830372.177349:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67d83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787830372.179896:0:25704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787830372.180240:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787830372.180278:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787830372.180289:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2913 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.180301:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25906c9000/0x8eaa8d1f2dfc290c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2913 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787830372.180313:0:22658:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787830372.180315:0:22658:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f24833f4800 from 13 10000000:01000000:1.0:1787830372.180318:0:22658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787830372.180357:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.180365:0:22658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.180375:0:22658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830372.180400:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787830372.180487:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830372.180528:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2586243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830372.181563:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842752 00000100:00100000:2.0:1787830372.181575:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842752 00000100:00100000:2.0:1787830372.181633:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787830372.181643:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+23:22658:x1874675316842752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787830372.181658:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830372.181674:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f25906c8200/0x8eaa8d1f2dfc2921 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8eaa8d1f2dfc291a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.181702:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f25906c8200/0x8eaa8d1f2dfc2921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc291a expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.181713:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f25906c8200/0x8eaa8d1f2dfc2921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8eaa8d1f2dfc291a expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.181722:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8200, rc 0) 00000100:00100000:2.0:1787830372.181792:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316842752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.181814:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787830372.185685:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787830372.185716:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2921 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830372.185768:0:22658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8eaa8d1f2dfc2921 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830372.185879:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830372.185943:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830372.185994:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2586243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787830372.188283:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316842880 00000100:00100000:2.0:1787830372.188300:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316842880 00000100:00100000:2.0:1787830372.188377:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787830372.188387:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316842880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787830372.188581:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316842880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.188589:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787830372.189177:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316842880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787830372.189241:0:22658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316843008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787830372.189315:0:22658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830372.189356:0:22658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2586243cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787830372.189418:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316843008 00000100:00100000:3.0:1787830372.189424:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316843008 00000100:00100000:3.0:1787830372.189487:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787830372.189496:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316843008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787830372.189605:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f65c475-02cd-4018-98b1-85148034a57b+24:22658:x1874675316843008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830372.189613:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787830372.189883:0:22658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b6013c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f65c475-02cd-4018-98b1-85148034a57b:22658:1874675316843008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787830372.192373:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787830372.192540:0:22658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787830372.192589:0:22658:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787830372.192603:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2921 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.192614:0:22658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f25b7d32800/0x8eaa8d1f2dfc291a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8eaa8d1f2dfc2921 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.412480:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.412810:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747712 00000100:00100000:0.0:1787830372.412822:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747712 00000100:00100000:0.0:1787830372.412905:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1787830372.412928:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:18757:x1874675295747712:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830372.412949:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.412975:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2928 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b64 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413039:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787830372.413048:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787830372.413054:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413083:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413213:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413221:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413228:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413457:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2800/0x8eaa8d1f2dfc293d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413467:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2800/0x8eaa8d1f2dfc293d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413475:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2800/0x8eaa8d1f2dfc293d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830372.413505:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787830372.413509:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830372.413547:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2800/0x8eaa8d1f2dfc293d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413558:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413565:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413571:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413578:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2c00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830372.413582:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413588:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413599:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:0.0:1787830372.413608:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830372.413613:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413619:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc292f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413633:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413639:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413645:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413650:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830372.413653:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413659:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413796:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f248245fe00) 00010000:00010000:0.0:1787830372.413800:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830372.413804:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413811:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413849:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2928 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b64 expref: 8 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413876:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2800/0x8eaa8d1f2dfc293d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b64 expref: 7 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.413884:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f248245f100) 00010000:00010000:0.0:1787830372.413886:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830372.413888:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2800, rc 0) 00000100:00100000:0.0:1787830372.413960:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18757:x1874675295747712:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1035us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830372.413969:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1787830372.417517:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.418091:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295747840 00000100:00100000:2.0:1787830372.418101:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295747840 00000100:00100000:2.0:1787830372.418219:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787830372.418230:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6013c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18757:x1874675295747840:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787830372.418329:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6013c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18757:x1874675295747840:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 Request processed in 100us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.418338:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787830372.421382:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830372.422637:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748096 00000100:00100000:3.0:1787830372.422651:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748096 00000100:00100000:3.0:1787830372.422805:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1787830372.422816:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483799680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18757:x1874675295748096:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830372.422840:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830372.422863:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b6b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423366:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423381:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423395:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423605:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423630:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423638:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423778:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125200/0x8eaa8d1f2dfc2959 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423787:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125200/0x8eaa8d1f2dfc2959 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.423795:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125200/0x8eaa8d1f2dfc2959 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830372.423805:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787830372.424845:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424860:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424868:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424875:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125600 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:3.0:1787830372.424879:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424887:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424914:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f248245f100) 00010000:00010000:3.0:1787830372.424917:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830372.424923:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424930:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc294b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424945:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424952:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424958:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424963:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124c00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:3.0:1787830372.424966:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424972:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424981:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f2482462d00) 00010000:00010000:3.0:1787830372.424983:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830372.424986:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.424992:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2952 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.426161:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b6b expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.426183:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125200/0x8eaa8d1f2dfc2959 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b6b expref: 9 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.426191:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f2482462300) 00010000:00010000:3.0:1787830372.426193:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830372.426196:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482125200, rc 0) 00000100:00100000:3.0:1787830372.426282:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483799680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18757:x1874675295748096:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 3467us (4907us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787830372.426291:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1787830372.442025:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.442189:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748224 00000100:00100000:2.0:1787830372.442200:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748224 00000100:00100000:2.0:1787830372.442271:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:2.0:1787830372.442282:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18757:x1874675295748224:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787830372.442574:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18757:x1874675295748224:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 285us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.442583:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1787830372.455404:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.456242:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748352 00000100:00100000:0.0:1787830372.456269:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748352 00000100:00100000:0.0:1787830372.456435:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787830372.456459:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6013840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:18757:x1874675295748352:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787830372.458088:0:22661:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1567us 00000100:00080000:1.0:1787830372.459987:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830372.464658:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.465132:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748480 00000100:00100000:2.0:1787830372.465143:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748480 00000100:00100000:2.0:1787830372.465212:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:2.0:1787830372.465223:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b60121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18763:x1874675295748480:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787830372.465247:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830372.465284:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc2967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b72 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.465354:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.465371:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466313:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466391:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466403:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466410:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466482:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466490:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466507:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466513:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9600 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830372.466518:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466526:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466539:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:2.0:1787830372.466542:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830372.466547:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466554:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc296e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466567:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466573:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466579:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466584:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8000 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830372.466597:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466612:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466621:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f258699c000) 00010000:00010000:2.0:1787830372.466624:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830372.466627:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466633:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2975 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466672:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc2967 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b72 expref: 10 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466696:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:2.0:1787830372.466699:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830372.466703:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc2967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b72 expref: 10 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.466712:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8c00, rc 0) 00000100:00100000:2.0:1787830372.466805:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b60121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18763:x1874675295748480:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1583us (2156us total) trans 0 rc 301/301 00000100:00100000:2.0:1787830372.466815:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1787830372.477321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.477419:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748608 00000100:00100000:2.0:1787830372.477432:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748608 00000100:00100000:2.0:1787830372.477494:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1787830372.477506:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18763:x1874675295748608:12345-192.168.204.30@tcp:700:lfs.0 00000100:00100000:2.0:1787830372.477624:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18763:x1874675295748608:12345-192.168.204.30@tcp:700:lfs.0 Request processed in 119us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.477632:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1787830372.480879:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6013840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:18757:x1874675295748352:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 24412us (25477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.480894:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787830372.486131:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830372.486218:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748864 00000100:00100000:3.0:1787830372.486229:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748864 00000100:00100000:3.0:1787830372.486329:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:3.0:1787830372.486341:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:18763:x1874675295748864:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:3.0:1787830372.486395:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830372.486433:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33000/0x8eaa8d1f2dfc2895 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827adf expref: 9 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.486457:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:3.0:1787830372.486461:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830372.486530:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.486544:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 5 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.486563:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.486598:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 5 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.486612:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 5 pid: 22662 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830372.486627:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833abc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874675316843136:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787830372.486711:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483c38540 going to sleep for 11 seconds 00000100:00100000:0.0:1787830372.496174:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.496298:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295748992 00000100:00100000:2.0:1787830372.496307:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295748992 00010000:00010000:2.0:1787830372.496365:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 6 pid: 22662 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.496400:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1787830372.496409:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2395:x1874675295748992:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830372.496423:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830372.496429:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 6 pid: 22662 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.496441:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 6 pid: 22662 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.496462:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:2.0:1787830372.496468:0:22648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.496477:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.496502:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.496520:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830372.496571:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2395:x1874675295748992:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 163us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.496579:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00010000:00010000:3.0:1787830372.497165:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32200/0x8eaa8d1f2dfc28d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b4f expref: 5 pid: 22662 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830372.497182:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833abc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874675316843136:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787830372.497204:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.497212:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.497218:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.497248:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.497270:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.497292:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787830372.498110:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787830372.499285:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499306:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499316:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830372.499332:0:22662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002aeb91a reply state 00000000f49c3416 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499343:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499349:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:3.0:1787830372.499352:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830372.499356:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787830372.499361:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787830372.499370:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499377:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499383:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499389:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125000 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:3.0:1787830372.499402:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499410:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499422:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f25b55eed00) 00010000:00010000:3.0:1787830372.499424:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830372.499428:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499434:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc297c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830372.499466:0:22662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002aeb91a reply state 00000000f49c3416 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499476:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.499483:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f2482462d00) 00010000:00010000:3.0:1787830372.499486:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830372.499569:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787830372.499751:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+10:18763:x1874675295748864:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 13388us (13603us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787830372.499769:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1787830372.660852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.660962:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295749120 00000100:00100000:2.0:1787830372.660972:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295749120 00000100:00100000:2.0:1787830372.661037:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1787830372.661047:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+10:18771:x1874675295749120:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:2.0:1787830372.661072:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830372.661095:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b79 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.661155:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc2998 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.661169:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc2998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.661181:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc2998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830372.661224:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787830372.661228:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830372.661390:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc2998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.661561:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b79 expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.661585:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9600/0x8eaa8d1f2dfc2998 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b79 expref: 11 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.661595:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:2.0:1787830372.661598:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830372.661601:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c9600, rc 0) 00000100:00100000:2.0:1787830372.661708:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+11:18771:x1874675295749120:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 660us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.661715:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:1.0:1787830372.696139:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.696604:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295749248 00000100:00100000:0.0:1787830372.696616:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295749248 00000100:00100000:0.0:1787830372.696683:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787830372.696693:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b60103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:18772:x1874675295749248:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787830372.696712:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.696750:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc299f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b80 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.696837:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2200/0x8eaa8d1f2dfc29a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.696850:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2200/0x8eaa8d1f2dfc29a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.696862:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2200/0x8eaa8d1f2dfc29a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830372.696911:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787830372.696915:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830372.697373:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2200/0x8eaa8d1f2dfc29a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.697606:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc299f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b80 expref: 7 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.697631:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2200/0x8eaa8d1f2dfc29a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b80 expref: 6 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.697641:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830372.697644:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787830372.697648:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2200, rc 0) 00000100:00100000:0.0:1787830372.697839:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b60103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18772:x1874675295749248:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1146us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830372.697849:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787830372.704795:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.704906:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295749376 00000100:00100000:2.0:1787830372.704917:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295749376 00000100:00100000:2.0:1787830372.705083:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1787830372.705094:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:18772:x1874675295749376:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787830372.705115:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830372.705137:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc29ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b87 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705218:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705232:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705243:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705280:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705288:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705295:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705382:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc29c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705402:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc29c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705410:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc29c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830372.705459:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787830372.705463:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830372.705624:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc29c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705639:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705645:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705652:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705669:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9800 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830372.705673:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705681:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705694:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:2.0:1787830372.705696:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830372.705700:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705707:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc29b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705721:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705763:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705768:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705773:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8a00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830372.705775:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705781:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705800:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f2482462d00) 00010000:00010000:2.0:1787830372.705803:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830372.705806:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705812:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc29bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705838:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc29ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b87 expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705852:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc29c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b87 expref: 7 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.705859:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:2.0:1787830372.705861:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830372.705863:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8c00, rc 0) 00000100:00100000:2.0:1787830372.705917:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+7:18772:x1874675295749376:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 824us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.705924:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:1.0:1787830372.710000:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830372.710154:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295749504 00000100:00100000:3.0:1787830372.710165:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295749504 00000100:00100000:3.0:1787830372.710268:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:3.0:1787830372.710278:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6012d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:18772:x1874675295749504:12345-192.168.204.30@tcp:900:lfs.0 00000100:00100000:3.0:1787830372.710364:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6012d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:18772:x1874675295749504:12345-192.168.204.30@tcp:900:lfs.0 Request processed in 87us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830372.710387:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00080000:1.0:1787830372.712070:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830372.718792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.718877:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295749760 00000100:00100000:0.0:1787830372.718901:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295749760 00000100:00100000:0.0:1787830372.718973:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1787830372.718984:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6012580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+7:18772:x1874675295749760:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787830372.719006:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.719026:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b8e expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830372.719130:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787830372.719248:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b8e expref: 9 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.719274:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830372.719277:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830372.719283:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b8e expref: 9 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.719297:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3e00, rc 0) 00000100:00100000:0.0:1787830372.719362:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6012580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+8:18772:x1874675295749760:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 379us (581us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1787830372.719369:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:3.0:1787830372.725003:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.725151:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295750016 00000100:00100000:0.0:1787830372.725162:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295750016 00000100:00100000:0.0:1787830372.725229:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:0.0:1787830372.725240:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+8:18772:x1874675295750016:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:0.0:1787830372.725303:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830372.725331:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8c00/0x8eaa8d1f2dfc29c2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b87 expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.725366:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:0.0:1787830372.725371:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787830372.725395:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.725407:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.725417:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787830372.725645:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aceb9c6e reply state 0000000001222307 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.725657:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.725663:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:0.0:1787830372.725665:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787830372.725667:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787830372.725674:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787830372.725779:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+9:18772:x1874675295750016:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 540us (785us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787830372.725786:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:1.0:1787830372.729649:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.729760:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295750272 00000100:00100000:2.0:1787830372.729770:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295750272 00000100:00100000:2.0:1787830372.729834:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1787830372.729845:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+9:18772:x1874675295750272:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787830372.730112:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+10:18772:x1874675295750272:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 267us (631us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787830372.730120:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000040:00080000:0.0:1787830372.733674:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787830372.739228:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.739334:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295750528 00000100:00100000:0.0:1787830372.739344:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295750528 00000100:00100000:0.0:1787830372.739407:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1787830372.739418:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6012940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+10:18772:x1874675295750528:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787830372.739470:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.739501:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc29de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b95 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739590:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739603:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739614:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739626:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739634:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739640:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830372.739793:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787830372.739868:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739877:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739884:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739900:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830372.739905:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739912:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739925:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830372.739928:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830372.739947:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739955:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc29e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739970:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739976:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739981:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739986:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2c00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830372.739989:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.739997:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.740016:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f2482462d00) 00010000:00010000:0.0:1787830372.740019:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830372.740022:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.740028:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc29ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.740064:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc29de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b95 expref: 12 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.740074:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830372.740077:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830372.740080:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc29de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b95 expref: 12 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.740090:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3800, rc 0) 00000100:00100000:0.0:1787830372.740150:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6012940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+11:18772:x1874675295750528:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 734us (931us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787830372.740157:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1787830372.748352:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.748766:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295750656 00000100:00100000:2.0:1787830372.748779:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295750656 00000100:00100000:2.0:1787830372.748855:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1787830372.748865:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+11:18772:x1874675295750656:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787830372.748888:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830372.748915:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc29fa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827b9c expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.749028:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.749045:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.749058:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830372.749084:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787830372.749088:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787830372.749107:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.749137:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc29fa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 13 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.749156:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.749164:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:2.0:1787830372.749167:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787830372.749186:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8a00, rc 0) 00000100:00100000:2.0:1787830372.749272:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+12:18772:x1874675295750656:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 408us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.749281:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:1.0:1787830372.757786:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.757859:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295750784 00000100:00100000:2.0:1787830372.757871:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295750784 00000100:00100000:2.0:1787830372.757946:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:2.0:1787830372.757957:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+12:18772:x1874675295750784:12345-192.168.204.30@tcp:37:lfs.0 00000100:00100000:2.0:1787830372.762576:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+12:18772:x1874675295750784:12345-192.168.204.30@tcp:37:lfs.0 Request processed in 4609us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.762591:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1787830372.794279:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830372.794370:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295751040 00000100:00100000:3.0:1787830372.794380:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295751040 00000100:00100000:3.0:1787830372.794438:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1787830372.794448:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+12:18772:x1874675295751040:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787830372.794697:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+13:18772:x1874675295751040:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 249us (432us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787830372.794706:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1787830372.877087:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.877193:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295751168 00000100:00100000:0.0:1787830372.877205:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295751168 00000100:00100000:0.0:1787830372.877281:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1787830372.877291:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+11:18778:x1874675295751168:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787830372.877313:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.877346:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827ba3 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877415:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877429:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877450:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877461:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877469:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877476:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877568:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2a1d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877577:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2a1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877585:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2a1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830372.877617:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787830372.877621:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830372.877658:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2a1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877675:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877682:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877689:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877695:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830372.877699:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877707:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877719:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830372.877722:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830372.877757:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877764:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877777:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877783:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877788:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877801:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830372.877804:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877809:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877817:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f2482462d00) 00010000:00010000:0.0:1787830372.877820:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830372.877822:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877829:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877853:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827ba3 expref: 13 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877867:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3200/0x8eaa8d1f2dfc2a1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827ba3 expref: 12 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.877874:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:0.0:1787830372.877877:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787830372.877879:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3200, rc 0) 00000100:00100000:0.0:1787830372.877947:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+12:18778:x1874675295751168:12345-192.168.204.30@tcp:101:bash.0 Request processed in 658us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830372.877956:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:1.0:1787830372.885299:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830372.885410:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295751296 00000100:00100000:3.0:1787830372.885421:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295751296 00000100:00100000:3.0:1787830372.885494:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:3.0:1787830372.885506:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:18778:x1874675295751296:12345-192.168.204.30@tcp:900:bash.0 00000100:00100000:3.0:1787830372.885599:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:18778:x1874675295751296:12345-192.168.204.30@tcp:900:bash.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830372.885607:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1787830372.888925:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.889082:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295751552 00000100:00100000:2.0:1787830372.889093:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295751552 00000100:00100000:2.0:1787830372.889160:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1787830372.889172:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+12:18778:x1874675295751552:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787830372.889195:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830372.889217:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2a24 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827baa expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.889342:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.889357:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.889367:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.889419:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.889446:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 12 pid: 22660 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.889462:0:22660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483799e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316843264:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830372.889552:0:22660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235780 going to sleep for 11 seconds 00000100:00100000:2.0:1787830372.892676:0:22660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483799e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316843264:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787830372.892711:0:22660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830372.906308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830372.907389:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295751680 00000100:00100000:2.0:1787830372.907403:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295751680 00010000:00010000:2.0:1787830372.907460:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 13 pid: 22660 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830372.907509:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1787830372.907520:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+13:2394:x1874675295751680:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830372.907535:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830372.907542:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 13 pid: 22660 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.907557:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 13 pid: 22660 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.907600:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8a00/0x8eaa8d1f2dfc2a01 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827b9c expref: 13 pid: 22660 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.907617:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:2.0:1787830372.907622:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.907632:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.907640:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830372.907775:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830372.907837:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+12:2394:x1874675295751680:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 318us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830372.907846:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00010000:00010000:3.0:1787830372.912403:0:22660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.912551:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.912635:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.912650:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.912680:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915122:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915146:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915158:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830372.915235:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830372.915285:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915294:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915302:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915309:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c9800 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:3.0:1787830372.915314:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915322:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915337:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:3.0:1787830372.915340:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787830372.915360:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915367:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2a2b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787830372.915385:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0c21a61 reply state 00000000a4e16f61 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915396:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915403:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f2482462e00) 00010000:00010000:3.0:1787830372.915406:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830372.915409:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787830372.915577:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2a24 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 15 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915594:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 14 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830372.915602:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830372.915604:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787830372.915606:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482124e00, rc 0) 00000100:00100000:3.0:1787830372.915693:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+15:18778:x1874675295751552:12345-192.168.204.30@tcp:101:bash.0 Request processed in 26523us (26777us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787830372.915703:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:1.0:1787830372.945858:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830372.945978:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295751808 00000100:00100000:0.0:1787830372.946007:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295751808 00000100:00100000:0.0:1787830372.946093:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:0.0:1787830372.946105:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+15:18778:x1874675295751808:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787830372.946144:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830372.946168:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a47 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bb1 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946260:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946284:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946298:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830372.946361:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787830372.946366:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830372.946384:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946395:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946423:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a47 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bb1 expref: 17 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946442:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bb1 expref: 16 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830372.946452:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830372.946461:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830372.946465:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2e00, rc 0) 00000100:00100000:0.0:1787830372.946539:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+16:18778:x1874675295751808:12345-192.168.204.30@tcp:101:bash.0 Request processed in 436us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830372.946548:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:1.0:1787830372.951999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830372.952243:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752064 00000100:00100000:3.0:1787830372.952265:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752064 00000100:00100000:3.0:1787830372.952670:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:3.0:1787830372.952681:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+16:18778:x1874675295752064:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1787830372.953152:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+17:18778:x1874675295752064:12345-192.168.204.30@tcp:35:bash.0 Request processed in 471us (1160us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1787830372.953162:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00010000:00010000:3.0:1787830372.993111:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830373.028681:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.028765:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.028807:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.028830:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.028861:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.028891:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752320 00000100:00100000:2.0:1787830373.028900:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752320 00000100:00100000:2.0:1787830373.028969:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752576 00000100:00100000:2.0:1787830373.028973:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752576 00000100:00100000:2.0:1787830373.028987:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752448 00000100:00100000:2.0:1787830373.028989:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752448 00000100:00100000:2.0:1787830373.029002:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752704 00000100:00100000:2.0:1787830373.029018:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752704 00000100:00100000:2.0:1787830373.029039:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1787830373.029048:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483799e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295752320:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830373.029122:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483799e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295752320:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 74us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.029130:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1787830373.029149:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1787830373.029156:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f248379b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295752576:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830373.029197:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f248379b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295752576:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.029204:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1787830373.029215:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1787830373.029222:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483798f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295752448:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830373.029258:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483798f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295752448:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.029265:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1787830373.029277:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1787830373.029284:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295752704:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830373.029307:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483795680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295752704:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.029314:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00080000:2.0:1787830373.029336:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787830373.029340:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787830373.029998:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752192 00000100:00100000:0.0:1787830373.030007:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752192 00000100:00100000:0.0:1787830373.030061:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:0.0:1787830373.030070:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2392:x1874675295752192:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830373.030121:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2392:x1874675295752192:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 52us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830373.030128:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:2.0:1787830373.084350:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830373.084867:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295752960 00000100:00100000:0.0:1787830373.084879:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295752960 00000100:00100000:0.0:1787830373.084955:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:0.0:1787830373.084965:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+17:18788:x1874675295752960:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787830373.084992:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830373.085014:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bb8 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830373.085123:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787830373.085239:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bb8 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.085267:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830373.085270:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830373.085285:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bb8 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.085309:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2c00, rc 0) 00000100:00100000:0.0:1787830373.085378:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483796d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+18:18788:x1874675295752960:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 414us (1036us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787830373.085386:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1787830373.089943:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.090076:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295753216 00000100:00100000:2.0:1787830373.090087:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295753216 00000100:00100000:2.0:1787830373.090144:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1787830373.090153:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+18:18788:x1874675295753216:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787830373.090400:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+19:18788:x1874675295753216:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 247us (475us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1787830373.090409:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1787830373.130686:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830373.130873:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295753472 00000100:00100000:0.0:1787830373.130886:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295753472 00000100:00100000:0.0:1787830373.130960:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:0.0:1787830373.130970:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+19:18791:x1874675295753472:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787830373.130995:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830373.131015:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a63 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bbf expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.131134:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a6a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.131150:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.131161:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830373.131433:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787830373.131545:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a63 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bbf expref: 22 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.131564:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bbf expref: 21 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.131593:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830373.131596:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830373.131599:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3e00, rc 0) 00000100:00100000:0.0:1787830373.131664:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18791:x1874675295753472:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 695us (988us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1787830373.131672:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1787830373.137204:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830373.137264:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830373.137410:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295753600 00000100:00100000:0.0:1787830373.137424:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295753600 00000100:00100000:0.0:1787830373.137496:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:0.0:1787830373.137509:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18791:x1874675295753600:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:0.0:1787830373.137578:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137598:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137610:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137648:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137655:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137662:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137668:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2c00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830373.137687:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137696:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137710:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830373.137713:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830373.137717:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.137747:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a78 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830373.137837:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18791:x1874675295753600:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 330us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830373.137845:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1787830373.138429:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295753728 00000100:00100000:2.0:1787830373.138437:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295753728 00000100:00100000:2.0:1787830373.138493:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1787830373.138502:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:2395:x1874675295753728:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830373.138515:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830373.138535:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a6a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bbf expref: 21 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830373.138550:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830373.138554:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830373.138595:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+20:2395:x1874675295753728:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 94us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.138602:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787830373.143795:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.143883:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295753984 00000100:00100000:2.0:1787830373.143894:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295753984 00000100:00100000:2.0:1787830373.143964:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787830373.143974:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+20:18791:x1874675295753984:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787830373.144240:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18791:x1874675295753984:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 267us (456us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787830373.144269:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000040:00080000:1.0:1787830373.437433:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787830373.486586:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830373.486715:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295754240 00000100:00100000:3.0:1787830373.486754:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295754240 00000100:00100000:3.0:1787830373.486832:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1787830373.486845:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18822:x1874675295754240:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:3.0:1787830373.486879:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830373.486904:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2a7f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bc6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.487045:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2a86 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.487061:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2a86 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.487073:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2a86 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830373.487088:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830373.487247:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2a7f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bc6 expref: 24 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.487269:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2a86 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bc6 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.487299:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830373.487302:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787830373.487305:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482124200, rc 0) 00000100:00100000:3.0:1787830373.487371:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+23:18822:x1874675295754240:12345-192.168.204.30@tcp:101:cat.0 Request processed in 528us (795us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1787830373.487379:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:1.0:1787830373.504406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.504513:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295754368 00000100:00100000:2.0:1787830373.504524:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295754368 00000100:00100000:2.0:1787830373.504597:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1787830373.504608:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+23:2395:x1874675295754368:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830373.504633:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830373.504666:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2a86 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bc6 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830373.504689:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830373.504694:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830373.504830:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+22:2395:x1874675295754368:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 223us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.504839:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:1.0:1787830373.507028:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830373.507286:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295754624 00000100:00100000:2.0:1787830373.507296:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295754624 00000100:00100000:2.0:1787830373.507395:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1787830373.507406:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+22:18822:x1874675295754624:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:2.0:1787830373.507720:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+23:18822:x1874675295754624:12345-192.168.204.30@tcp:35:cat.0 Request processed in 314us (700us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1787830373.507752:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787830373.624489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830373.631515:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295754880 00000100:00100000:0.0:1787830373.631537:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295754880 00000100:00100000:0.0:1787830373.631624:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:0.0:1787830373.631647:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+23:18828:x1874675295754880:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:0.0:1787830373.631674:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830373.631695:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a94 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bcd expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.631840:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a9b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.631856:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a9b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.631903:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a9b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830373.631916:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787830373.632503:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2a94 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bcd expref: 26 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.632523:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a9b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bcd expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830373.632532:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830373.632535:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830373.632538:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3e00, rc 0) 00000100:00100000:0.0:1787830373.634654:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18828:x1874675295754880:12345-192.168.204.30@tcp:101:dd.0 Request processed in 3008us (10231us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1787830373.634668:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:1.0:1787830373.647278:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830373.647381:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830373.647615:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295755008 00000100:00100000:3.0:1787830373.647627:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295755008 00000100:00100000:3.0:1787830373.647702:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1787830373.647714:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18828:x1874675295755008:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:3.0:1787830373.647914:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830373.647941:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2aa9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bd4 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.647988:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.648005:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.648018:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.648173:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2aa9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 27 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.648194:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 26 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.648212:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830373.648215:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787830373.648218:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482124200, rc 0) 00000100:00100000:3.0:1787830373.648897:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+26:18828:x1874675295755008:12345-192.168.204.30@tcp:101:dd.0 Request processed in 1181us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830373.648907:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:2.0:1787830373.649126:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295755136 00000100:00100000:2.0:1787830373.649135:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295755136 00000100:00100000:2.0:1787830373.649189:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1787830373.649198:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+26:2394:x1874675295755136:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830373.649226:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830373.649257:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2a9b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bcd expref: 26 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830373.649274:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830373.649279:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830373.649316:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:2394:x1874675295755136:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 119us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830373.649324:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1787830373.653515:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830373.653642:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295755392 00000100:00100000:3.0:1787830373.653653:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295755392 00000100:00100000:3.0:1787830373.653714:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1787830373.653760:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18828:x1874675295755392:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:3.0:1787830373.653817:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830373.653842:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2a4e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bb1 expref: 25 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.653863:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830373.653868:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830373.654057:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.654073:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.654083:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830373.654128:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787830373.654151:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da3b1477 reply state 00000000bce24e9a transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.654180:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830373.654187:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830373.654190:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830373.654193:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787830373.654298:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+27:18828:x1874675295755392:12345-192.168.204.30@tcp:36:dd.0 Request processed in 574us (791us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787830373.654305:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000020:00080000:3.0:1787830373.654310:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787830373.828353:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830373.828442:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295755648 00000100:00100000:3.0:1787830373.828453:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295755648 00000100:00100000:3.0:1787830373.828559:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1787830373.828570:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+27:18828:x1874675295755648:12345-192.168.204.30@tcp:35:dd.0 00000100:00100000:3.0:1787830373.828839:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+28:18828:x1874675295755648:12345-192.168.204.30@tcp:35:dd.0 Request processed in 270us (497us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787830373.828848:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00010000:00010000:2.0:1787830374.016183:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787830374.041211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830374.041349:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295755776 00000100:00100000:0.0:1787830374.041363:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295755776 00000100:00100000:0.0:1787830374.041462:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:0.0:1787830374.041475:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+28:18842:x1874675295755776:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1787830374.041513:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830374.041539:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2abe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bdb expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041650:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041697:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041710:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041761:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041770:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041776:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041883:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041893:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.041902:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830374.041972:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787830374.041977:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830374.042033:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042048:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042070:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042077:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042084:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042090:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3800 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830374.042095:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042104:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042120:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:0.0:1787830374.042123:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830374.042130:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042138:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2ac5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042155:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042163:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042168:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042181:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830374.042184:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042190:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042198:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f2482462e00) 00010000:00010000:0.0:1787830374.042200:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830374.042203:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042209:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2acc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042259:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2abe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bdb expref: 30 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042287:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bdb expref: 29 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.042294:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830374.042297:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830374.042299:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3e00, rc 0) 00000100:00100000:0.0:1787830374.042395:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+29:18842:x1874675295755776:12345-192.168.204.30@tcp:101:stat.0 Request processed in 922us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830374.042404:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00080000:2.0:1787830374.043043:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787830374.112975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830374.119528:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295756032 00000100:00100000:3.0:1787830374.119544:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295756032 00000100:00100000:3.0:1787830374.119703:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:3.0:1787830374.119714:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+29:18848:x1874675295756032:12345-192.168.204.30@tcp:36:truncate.0 00010000:00010000:3.0:1787830374.119786:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830374.119890:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2ad3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bdb expref: 29 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.119912:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830374.119930:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787830374.120113:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.120130:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.120141:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830374.120185:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1787830374.120208:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000227680b3 reply state 00000000115d9309 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.120220:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.120241:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830374.120244:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830374.120246:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787830374.121737:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+31:18848:x1874675295756032:12345-192.168.204.30@tcp:36:truncate.0 Request processed in 674us (7420us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787830374.121763:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000020:00080000:3.0:1787830374.121772:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787830374.141686:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316843392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787830374.141810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830374.142200:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316843392 00000100:00100000:2.0:1787830374.142211:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316843392 00000100:00100000:2.0:1787830374.142312:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787830374.142322:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316843392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787830374.142356:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1787830374.142479:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830374.143433:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874675316843392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1108us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830374.143444:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787830374.143947:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25b67da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874675316843392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830374.264960:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830374.265082:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295756160 00000100:00100000:0.0:1787830374.265117:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295756160 00000100:00100000:0.0:1787830374.265236:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787830374.265249:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+31:18862:x1874675295756160:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1787830374.265275:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830374.265299:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2ae1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827be2 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265380:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265396:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265408:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265419:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265426:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265433:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265509:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265519:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265526:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830374.265575:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787830374.265580:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787830374.265794:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265807:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265814:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265820:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265825:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265831:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e2e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830374.265834:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265841:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265852:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:0.0:1787830374.265855:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830374.265859:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265866:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2ae8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265890:0:24451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265896:0:24451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265902:0:24451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265908:0:24451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3800 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830374.265910:0:24451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265917:0:24451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265925:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f2482462e00) 00010000:00010000:0.0:1787830374.265927:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787830374.265931:0:24451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.265937:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2aef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.266122:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2ae1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 33 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.266141:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 32 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.266161:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830374.266163:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830374.266166:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3e00, rc 0) 00000100:00100000:0.0:1787830374.266240:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+32:18862:x1874675295756160:12345-192.168.204.30@tcp:101:stat.0 Request processed in 993us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830374.266247:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:2.0:1787830374.347240:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830374.347412:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295756416 00000100:00100000:0.0:1787830374.347426:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295756416 00000100:00100000:0.0:1787830374.347501:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:0.0:1787830374.347512:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+32:18872:x1874675295756416:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787830374.347542:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830374.347566:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827be9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787830374.347669:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787830374.347834:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2afd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be9 expref: 34 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.347852:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:0.0:1787830374.347855:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787830374.347861:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be9 expref: 34 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.347879:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2c00, rc 0) 00000100:00100000:0.0:1787830374.348181:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483794780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+33:18872:x1874675295756416:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 669us (964us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1787830374.348210:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:1.0:1787830374.363962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830374.364103:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295756672 00000100:00100000:3.0:1787830374.364117:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295756672 00000100:00100000:3.0:1787830374.364482:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787830374.364495:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+33:18872:x1874675295756672:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787830374.364788:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+34:18872:x1874675295756672:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 295us (834us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787830374.364797:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787830374.448812:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830374.449770:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295756928 00000100:00100000:3.0:1787830374.449784:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295756928 00000100:00100000:2.0:1787830374.450201:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1787830374.450213:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+34:18878:x1874675295756928:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787830374.450252:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830374.450277:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2b0b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bf0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450446:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450461:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 35 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450470:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 35 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450479:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450521:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 35 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450537:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 35 pid: 24451 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830374.450563:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd321a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874675316843520:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787830374.450671:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 35 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.450680:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 35 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830374.450690:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874675316843648:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830374.450720:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25bd235600 going to sleep for 11 seconds 00000100:00100000:2.0:1787830374.454829:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830374.454942:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830374.455014:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295757056 00000100:00100000:2.0:1787830374.455024:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295757056 00010000:00010000:2.0:1787830374.455070:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 36 pid: 24451 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830374.455102:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295757184 00000100:00100000:2.0:1787830374.455105:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295757184 00010000:00010000:2.0:1787830374.455119:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 37 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830374.455140:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1787830374.455150:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:2395:x1874675295757056:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830374.455188:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830374.455197:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 37 pid: 24451 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455211:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 37 pid: 24451 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455249:0:23413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830374.455255:0:23413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455264:0:23413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455282:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830374.455338:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:2395:x1874675295757056:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 189us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830374.455347:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1787830374.455395:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:2.0:1787830374.455402:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd3221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+36:2395:x1874675295757184:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787830374.455409:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830374.455414:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 36 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455423:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 36 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455434:0:23413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830374.455438:0:23413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455446:0:23413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455453:0:23413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.455469:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787830374.455488:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd3221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+36:2395:x1874675295757184:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 87us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830374.455494:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00010000:00010000:3.0:1787830374.456796:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3e00/0x8eaa8d1f2dfc2af6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827be2 expref: 35 pid: 24451 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830374.456821:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd321a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874675316843520:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787830374.456837:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2a39 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827baa expref: 34 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830374.456848:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bd320000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874675316843648:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787830374.456872:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.456881:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.456887:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830374.456922:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787830374.457062:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2b0b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 35 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.457079:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 34 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.457103:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830374.457106:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787830374.457109:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8000, rc 0) 00000100:00100000:3.0:1787830374.457162:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+34:18878:x1874675295756928:12345-192.168.204.30@tcp:101:bash.0 Request processed in 6952us (8362us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1787830374.457170:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1787830374.461892:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830374.462489:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295757440 00000100:00100000:3.0:1787830374.462499:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295757440 00000100:00100000:3.0:1787830374.462666:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787830374.462678:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+34:18878:x1874675295757440:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:3.0:1787830374.463324:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.463343:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.463354:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787830374.463397:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1787830374.463418:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032096b2f reply state 000000004491a4b5 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.463431:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.463438:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830374.463440:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787830374.463452:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787830374.463675:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18878:x1874675295757440:12345-192.168.204.30@tcp:36:bash.0 Request processed in 996us (1790us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1787830374.463683:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000020:00080000:3.0:1787830374.463688:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787830374.467699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830374.467809:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295757568 00000100:00100000:0.0:1787830374.467822:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295757568 00000100:00100000:0.0:1787830374.467884:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:0.0:1787830374.468074:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd322940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18878:x1874675295757568:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787830374.468100:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830374.468121:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b27 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bf7 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.468323:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf7 expref: 38 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.468339:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf7 expref: 38 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.468357:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830374.468360:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787830374.468363:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2c00, rc 0) 00000100:00100000:0.0:1787830374.468411:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd322940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18878:x1874675295757568:12345-192.168.204.30@tcp:101:bash.0 Request processed in 519us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830374.468419:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1787830374.477321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830374.477823:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295757696 00000100:00100000:0.0:1787830374.477836:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295757696 00000100:00100000:0.0:1787830374.478054:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1787830374.478067:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd3212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18878:x1874675295757696:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787830374.478089:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830374.478129:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2b2e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827bfe expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.478928:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.478949:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 39 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.478959:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.479780:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 39 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.479801:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 39 pid: 22662 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830374.479839:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483c90000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22661:1874675316843776:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787830374.480685:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f258871d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787830374.486542:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483c90000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22661:1874675316843776:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830374.487821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:1.0:1787830374.487937:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830374.488263:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295757824 00000100:00100000:0.0:1787830374.488273:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295757824 00010000:00010000:0.0:1787830374.488311:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 40 pid: 22662 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830374.488352:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787830374.488362:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+40:2395:x1874675295757824:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830374.488377:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830374.488384:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 40 pid: 22662 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.488398:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 40 pid: 22662 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.488421:0:23413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b12 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf0 expref: 40 pid: 22662 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.488457:0:23413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:0.0:1787830374.488462:0:23413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.488471:0:23413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.488478:0:23413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830374.488509:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830374.488892:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.488917:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830374.488993:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787830374.488998:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830374.489023:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.489060:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2b2e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bfe expref: 40 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.489076:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bfe expref: 39 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.489083:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:1.0:1787830374.489086:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787830374.489089:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2e00, rc 0) 00000100:00100000:1.0:1787830374.489154:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd3212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+39:18878:x1874675295757696:12345-192.168.204.30@tcp:101:bash.0 Request processed in 11090us (12616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830374.489173:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1787830374.489860:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:2395:x1874675295757824:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1495us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830374.489870:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1787830374.496471:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830374.496573:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758080 00000100:00100000:1.0:1787830374.496586:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758080 00000100:00100000:1.0:1787830374.496660:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1787830374.496672:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd321a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18878:x1874675295758080:12345-192.168.204.30@tcp:103:bash.0 00010000:00010000:1.0:1787830374.496689:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787830374.496717:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b27 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bf7 expref: 38 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.496774:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b35 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bfe expref: 37 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830374.496784:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:1.0:1787830374.496788:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830374.496894:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd321a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+36:18878:x1874675295758080:12345-192.168.204.30@tcp:103:bash.0 Request processed in 224us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830374.496916:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:2.0:1787830374.504305:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830374.504604:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758208 00000100:00100000:3.0:1787830374.504614:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758208 00000100:00100000:3.0:1787830374.504677:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:3.0:1787830374.504686:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6011a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+36:18878:x1874675295758208:12345-192.168.204.30@tcp:58:bash.0 00010000:00010000:3.0:1787830374.504838:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.504857:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830374.504870:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787830374.507282:0:22662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787830374.507323:0:22662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1787830374.508712:0:22662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1787830374.508869:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6011a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+36:18878:x1874675295758208:12345-192.168.204.30@tcp:58:bash.0 Request processed in 4175us (4565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830374.508883:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1787830374.512709:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830374.516061:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758336 00000100:00100000:3.0:1787830374.516083:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758336 00000100:00100000:2.0:1787830374.518427:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:2.0:1787830374.518442:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b6010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+36:18878:x1874675295758336:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787830374.518467:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830374.518489:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c05 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.518547:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.518560:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 37 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.518582:0:22660:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.518596:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 37 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.518611:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830374.518615:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787830374.518619:0:22660:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 37 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830374.518642:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8000, rc 0) 00000100:00100000:2.0:1787830374.518721:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b6010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18878:x1874675295758336:12345-192.168.204.30@tcp:101:bash.0 Request processed in 282us (6022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830374.518754:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00010000:00010000:0.0:1787830375.037073:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787830375.485005:0:22696:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787830375.485019:0:22696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787830375.485059:0:22696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787830375.485068:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787830375.485374:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2483c90000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22696:1874675316843904:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787830375.485549:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2588010d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787830375.500592:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2483c90000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22696:1874675316843904:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787830375.509319:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830375.509970:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758464 00000100:00100000:0.0:1787830375.509982:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758464 00000100:00100000:0.0:1787830375.510096:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:0.0:1787830375.510108:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18879:x1874675295758464:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787830375.510151:0:24451:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787830375.510295:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18879:x1874675295758464:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 188us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830375.510304:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:2.0:1787830375.520698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.520827:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758592 00000100:00100000:1.0:1787830375.520852:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758592 00000100:00100000:1.0:1787830375.520927:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:1.0:1787830375.520938:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24836eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18879:x1874675295758592:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787830375.521014:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521031:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521044:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521060:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521067:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521073:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521096:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521104:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521111:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787830375.521341:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787830375.521346:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787830375.521370:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521383:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521389:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521397:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521402:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d32e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:1.0:1787830375.521406:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521413:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521425:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f2482462300) 00010000:00010000:1.0:1787830375.521428:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830375.521433:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521440:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d32e00/0x8eaa8d1f2dfc2b4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521452:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521458:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521464:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521475:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d33200 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:1.0:1787830375.521479:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521484:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521493:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9f25b55ee000) 00010000:00010000:1.0:1787830375.521495:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830375.521498:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521503:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521518:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521524:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521530:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521536:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d33a00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:1.0:1787830375.521538:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521544:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521562:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:1.0:1787830375.521565:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830375.521568:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.521575:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b58 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.521660:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24836eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18879:x1874675295758592:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 724us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.521669:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:2.0:1787830375.529596:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.529853:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758848 00000100:00100000:3.0:1787830375.529866:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758848 00000100:00100000:3.0:1787830375.530290:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:3.0:1787830375.530306:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+37:18879:x1874675295758848:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830375.530344:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830375.530367:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2b5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c0c expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530487:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530506:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530518:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830375.530529:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787830375.530625:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530633:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530640:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530646:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:3.0:1787830375.530650:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530658:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530670:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:3.0:1787830375.530680:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787830375.530685:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.530691:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2b66 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.531309:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2b5f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c0c expref: 39 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.531325:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f2482462300) 00010000:00010000:3.0:1787830375.531328:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787830375.531332:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2b5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c0c expref: 39 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.531343:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482125400, rc 0) 00000100:00100000:3.0:1787830375.531472:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18879:x1874675295758848:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1169us (1884us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1787830375.531480:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:2.0:1787830375.537564:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.537708:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295758976 00000100:00100000:1.0:1787830375.537757:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295758976 00000100:00100000:1.0:1787830375.537827:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1787830375.537837:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18879:x1874675295758976:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787830375.537875:0:22661:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787830375.538025:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18879:x1874675295758976:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 189us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.538033:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:2.0:1787830375.545519:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830375.545800:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295759232 00000100:00100000:0.0:1787830375.545812:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295759232 00000100:00100000:0.0:1787830375.545896:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1787830375.545908:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+38:18879:x1874675295759232:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830375.545959:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830375.545987:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b74 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c13 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787830375.546444:0:24451:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1787830375.546453:0:24451:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1787830375.546478:0:24451:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1787830375.546637:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b7b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.546652:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.546665:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.546796:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b74 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c13 expref: 41 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.546817:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b7b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c13 expref: 40 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.546831:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245fe00) 00010000:00010000:0.0:1787830375.546834:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787830375.546838:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e2c00, rc 0) 00000100:00100000:0.0:1787830375.546917:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+40:18879:x1874675295759232:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1010us (1412us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1787830375.546926:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:2.0:1787830375.561989:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.562154:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295759488 00000100:00100000:1.0:1787830375.562166:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295759488 00000100:00100000:1.0:1787830375.562242:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:1.0:1787830375.562255:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b66fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+40:18879:x1874675295759488:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787830375.562323:0:22661:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830375.562354:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2c00/0x8eaa8d1f2dfc2b7b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c13 expref: 40 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562394:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245fe00) 00010000:00010000:1.0:1787830375.562406:0:22661:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787830375.562430:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562445:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562455:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562468:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562475:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562481:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562533:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562541:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562548:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562554:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d33a00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:1.0:1787830375.562559:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562577:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562586:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:1.0:1787830375.562589:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830375.562593:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562599:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33a00/0x8eaa8d1f2dfc2b89 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562609:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562615:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562621:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562626:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d33200 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:1.0:1787830375.562629:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562635:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562641:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x5faac18b (ffff9f25b55ee000) 00010000:00010000:1.0:1787830375.562644:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787830375.562646:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.562660:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2b90 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5faac18b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.563113:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b66fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+39:18879:x1874675295759488:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 858us (1132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787830375.563124:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1787830375.581088:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830375.581189:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295759616 00000100:00100000:0.0:1787830375.581233:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295759616 00000100:00100000:0.0:1787830375.581296:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1787830375.581307:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+39:18879:x1874675295759616:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787830375.581330:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787830375.581355:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b97 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c1a expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.581584:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2b9e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.581599:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2b9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.581612:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2b9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.587685:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e2e00/0x8eaa8d1f2dfc2b97 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c1a expref: 41 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.587820:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3800/0x8eaa8d1f2dfc2b9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c1a expref: 40 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.587831:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:2.0:1787830375.587835:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830375.587839:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f24825e3800, rc 0) 00000100:00100000:2.0:1787830375.588002:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+40:18879:x1874675295759616:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 6695us (6924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.588012:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:2.0:1787830375.603658:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.603948:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295759872 00000100:00100000:1.0:1787830375.603960:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295759872 00000100:00100000:1.0:1787830375.604030:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:1.0:1787830375.604040:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+40:18879:x1874675295759872:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787830375.604121:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.604138:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.604150:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787830375.604489:0:22661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1787830375.604500:0:22661:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764822774241ns, next at 765822771696ns, rc = 0 00000004:00010000:1.0:1787830375.604555:0:22661:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000886f3eb9 reply state 00000000c45bee7c transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.604569:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.604576:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:1.0:1787830375.604593:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787830375.604597:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787830375.604708:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+42:18879:x1874675295759872:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 667us (1060us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1787830375.607483:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:2.0:1787830375.607958:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.608149:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295760000 00000100:00100000:3.0:1787830375.608168:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295760000 00000100:00100000:3.0:1787830375.608229:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1787830375.608240:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+42:18879:x1874675295760000:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830375.608263:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830375.608282:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c21 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.608337:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 43 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.608379:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 43 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.608401:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:3.0:1787830375.608405:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787830375.608408:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482125400, rc 0) 00000100:00100000:3.0:1787830375.609353:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+43:18879:x1874675295760000:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.609917:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1787830375.616336:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.616614:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295760128 00000100:00100000:2.0:1787830375.616641:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295760128 00000100:00100000:2.0:1787830375.616769:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:2.0:1787830375.616781:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2394:x1874675295760128:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787830375.617055:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2394:x1874675295760128:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 276us (863us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787830375.617064:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00080000:1.0:1787830375.618254:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787830375.620275:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.620426:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295760384 00000100:00100000:3.0:1787830375.620494:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295760384 00000100:00100000:3.0:1787830375.620564:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:3.0:1787830375.620575:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+43:18879:x1874675295760384:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787830375.620837:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+44:18879:x1874675295760384:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 263us (574us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787830375.620846:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787830375.624400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.624522:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295760640 00000100:00100000:2.0:1787830375.624532:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295760640 00000100:00100000:2.0:1787830375.624599:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:2.0:1787830375.624610:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+44:18879:x1874675295760640:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787830375.624802:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+44:18879:x1874675295760640:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 193us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.624810:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:2.0:1787830375.627774:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.627940:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295760768 00000100:00100000:3.0:1787830375.627952:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295760768 00000100:00100000:3.0:1787830375.628058:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:3.0:1787830375.628070:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+44:18879:x1874675295760768:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787830375.628093:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787830375.628128:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bb3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c28 expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.628242:0:24451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125c00/0x8eaa8d1f2dfc2bba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.628260:0:24451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125c00/0x8eaa8d1f2dfc2bba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.628272:0:24451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125c00/0x8eaa8d1f2dfc2bba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787830375.628321:0:24451:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787830375.628342:0:24451:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125c00/0x8eaa8d1f2dfc2bba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.628370:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bb3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c28 expref: 46 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.628390:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125c00/0x8eaa8d1f2dfc2bba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c28 expref: 45 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.628399:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:3.0:1787830375.628402:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787830375.628406:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2482125c00, rc 0) 00000100:00100000:3.0:1787830375.628478:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+45:18879:x1874675295760768:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 410us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.628486:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:0.0:1787830375.631780:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.631895:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295760896 00000100:00100000:2.0:1787830375.631906:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295760896 00000100:00100000:2.0:1787830375.631965:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:2.0:1787830375.631975:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b67da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2395:x1874675295760896:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787830375.631998:0:24170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830375.632020:0:24170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c2f expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787830375.632044:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902067, blocks: 0x0 00010000:00010000:2.0:1787830375.632064:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=764s v=(0 0) 00010000:00010000:2.0:1787830375.632069:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830375.632094:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 7 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.632115:0:24170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 7 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.632138:0:24170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8c00, rc 0) 00000100:00100000:2.0:1787830375.634345:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b67da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:2395:x1874675295760896:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 218us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.634367:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787830375.635934:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.636148:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295761152 00000100:00100000:1.0:1787830375.636158:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295761152 00000100:00100000:1.0:1787830375.636364:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1787830375.636377:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+45:18879:x1874675295761152:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787830375.636642:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+45:18879:x1874675295761152:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 268us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.636651:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:0.0:1787830375.640666:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.641014:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295761280 00000100:00100000:2.0:1787830375.641024:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295761280 00000100:00100000:2.0:1787830375.641133:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:2.0:1787830375.641145:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+45:18879:x1874675295761280:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787830375.643548:0:22641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1787830375.643564:0:22641:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787830375.643633:0:22641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1787830375.643852:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316844032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787830375.643939:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.644042:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316844032 00000100:00100000:3.0:1787830375.644050:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316844032 00000100:00100000:3.0:1787830375.644106:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787830375.644138:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316844032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787830375.644283:0:24169:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787830375.644287:0:24169:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787830375.644289:0:24169:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787830375.644291:0:24169:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787830375 -> 1787830375 00002000:00010000:3.0:1787830375.644293:0:24169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787830375.644338:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1874675316844032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (398us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787830375.644346:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787830375.644600:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.644610:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.644618:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.644624:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f24825e3400 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:0.0:1787830375.644629:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.644645:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.644663:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:0.0:1787830375.644666:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787830375.644672:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.644679:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f24825e3400/0x8eaa8d1f2dfc29d7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787830375.644791:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f24833ab840/2, rc 0, transno 12884901892 00000100:00100000:1.0:1787830375.644799:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316844032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787830375.645076:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+20:18879:x1874675295761280:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 3932us (4421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.645086:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00010000:00010000:2.0:1787830375.648796:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.648893:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.648904:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.648912:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124c00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.648997:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649007:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649048:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f2482462d00) 00010000:00010000:2.0:1787830375.649208:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.649215:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649223:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124c00/0x8eaa8d1f2dfc2983 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649249:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649256:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649262:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649267:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125600 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.649271:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649277:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649286:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:2.0:1787830375.649288:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.649413:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649419:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125600/0x8eaa8d1f2dfc298a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649446:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649453:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649463:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649469:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125000 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.649472:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649478:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649487:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f2482462e00) 00010000:00010000:2.0:1787830375.649490:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.649493:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649499:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125000/0x8eaa8d1f2dfc2a32 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649514:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649520:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830375.649541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:2.0:1787830375.649589:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649601:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125a00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.649604:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649611:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649620:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.649622:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.649625:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649631:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125a00/0x8eaa8d1f2dfc2ab7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649642:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649648:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649654:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649659:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124000 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.649661:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830375.649673:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295761408 00000100:00100000:3.0:1787830375.649683:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295761408 00010000:00010000:2.0:1787830375.649754:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649771:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.649773:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.649777:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649783:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124000/0x8eaa8d1f2dfc2ada lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649797:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649804:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649809:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649814:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124400 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.649816:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649895:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.649904:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.649907:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.649910:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.649970:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00010000:00010000:2.0:1787830375.649980:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124400/0x8eaa8d1f2dfc2b20 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.649986:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:2395:x1874675295761408:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787830375.650009:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.650016:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.650022:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.650027:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25b7d33200 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.650030:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.650036:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.650046:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00000100:00100000:1.0:1787830375.650107:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:2395:x1874675295761408:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 125us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.650125:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00010000:00010000:2.0:1787830375.650370:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787830375.650375:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.650382:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25b7d33200/0x8eaa8d1f2dfc2ba5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830375.653424:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.653562:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295761664 00000100:00100000:2.0:1787830375.653573:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295761664 00000100:00100000:2.0:1787830375.653721:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1787830375.653820:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+14:18879:x1874675295761664:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787830375.653942:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787830375.653997:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125c00/0x8eaa8d1f2dfc2bba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c28 expref: 14 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.654057:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:2.0:1787830375.654064:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787830375.654116:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2bc8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.654131:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2bc8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.654141:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2bc8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830375.654294:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c621b876 reply state 0000000000162ca4 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2bc8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.654318:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c9800/0x8eaa8d1f2dfc2bc8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.654325:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:2.0:1787830375.654327:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787830375.654330:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787830375.654452:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+15:18879:x1874675295761664:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 664us (1038us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1787830375.654461:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1787830375.664071:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.664459:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295761792 00000100:00100000:2.0:1787830375.664471:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295761792 00000100:00100000:2.0:1787830375.664553:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1787830375.664573:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18879:x1874675295761792:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787830375.664598:0:24169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830375.664631:0:24169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c36 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.664667:0:24169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 8 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.664678:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830375.664683:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830375.664689:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.664776:0:24169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 8 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.664792:0:24169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 8 pid: 24170 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.664810:0:24169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24169:1874675316844160:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830375.664922:0:24169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830375.668337:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.668590:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295761920 00000100:00100000:1.0:1787830375.668614:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295761920 00010000:00010000:1.0:1787830375.668659:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 9 pid: 24170 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.668707:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1787830375.668718:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:2395:x1874675295761920:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830375.668770:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830375.668795:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 9 pid: 24170 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.668805:0:24169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24169:1874675316844160:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787830375.668814:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 9 pid: 24170 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.668986:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c2f expref: 9 pid: 24170 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.671629:0:24169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.671661:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830375.671666:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830375.671675:0:24169:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.671710:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.671974:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830375.672052:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:2395:x1874675295761920:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3334us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.672064:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00010000:00010000:2.0:1787830375.672110:0:24169:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 7 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.672132:0:24169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24169:1874675316844288:192.168.204.30@tcp:105: 00000100:00100000:2.0:1787830375.672209:0:24169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787830375.675145:0:24169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24169:1874675316844288:192.168.204.30@tcp:105: 00010000:00010000:2.0:1787830375.675174:0:24169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25906c8a00, rc 0) 00000100:00100000:2.0:1787830375.675295:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18879:x1874675295761792:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 10723us (11235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.675311:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1787830375.676912:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316844544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830375.676990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.677011:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316844416:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.677302:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874675316844928:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.677359:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316845440:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.677394:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874675316845952:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830375.677434:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316844928 00000100:00100000:3.0:1787830375.677437:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787830375.677442:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316844928 00000100:00100000:3.0:1787830375.677445:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316844800:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830375.677490:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845440 00000100:00100000:1.0:1787830375.677497:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845440 00000100:00100000:1.0:1787830375.677510:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316844800 00000100:00100000:3.0:1787830375.677511:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316845312:0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.677514:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316844800 00000100:00100000:3.0:1787830375.677535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.677549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874675316845824:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.677597:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845952 00000100:00100000:3.0:1787830375.677601:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845952 00000100:00100000:3.0:1787830375.677625:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845824 00000100:00100000:3.0:1787830375.677627:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845824 00000100:00100000:3.0:1787830375.677640:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787830375.677647:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874675316844928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677691:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874675316844928:12345-0@lo:400:kworker.0 Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.677697:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787830375.677748:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874675316844928:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677768:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787830375.677774:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874675316845952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677803:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874675316845952:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.677809:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787830375.677836:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f258b7dbc00 x1874675316845952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787830375.677846:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874675316845952:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677864:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830375.677870:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874675316845824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.677909:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874675316845824:12345-0@lo:400:kworker.0 Request processed in 39us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.677922:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787830375.677948:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874675316845824:0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.679224:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845312 00000100:00100000:1.0:1787830375.679231:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845312 00000100:00100000:1.0:1787830375.679273:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787830375.679281:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316844800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.679341:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874675316844800:12345-0@lo:400:kworker.0 Request processed in 61us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.679347:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787830375.679360:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787830375.679365:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316845312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.679386:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316845312:12345-0@lo:400:kworker.0 Request processed in 22us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.679392:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787830375.679413:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787830375.679417:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787830375.679420:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830375.679445:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787830375.679451:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316845440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.679479:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874675316845440:12345-0@lo:400:kworker.0 Request processed in 29us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.679485:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787830375.679641:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316845056:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.679680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830375.679754:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316845568:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.679778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830375.679791:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316846080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830375.679810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830375.679827:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787830375.679840:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24833aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316844672:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.679860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.680061:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874675316844800:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.680072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316845312:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.680082:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874675316845440:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.680348:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.680373:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845568 00000100:00100000:3.0:1787830375.680377:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845568 00000100:00100000:3.0:1787830375.680412:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830375.680419:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316845568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.680455:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd298780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874675316845568:12345-0@lo:400:kworker.0 Request processed in 37us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.680462:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830375.683114:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316844416 00000100:00100000:3.0:1787830375.683141:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316844416 00000100:00100000:3.0:1787830375.683219:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787830375.683231:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:3638:x1874675316844416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.683332:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316845184:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.683388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787830375.683401:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f65c475-02cd-4018-98b1-85148034a57b+24:3638:x1874675316844416:12345-0@lo:400:kworker.0 Request processed in 171us (6135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.683411:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787830375.683422:0:25270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762048 00000100:00100000:2.0:1787830375.683428:0:25270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762048 00000100:00100000:2.0:1787830375.683459:0:25270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845184 00000100:00100000:2.0:1787830375.683462:0:25270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845184 00000100:00100000:3.0:1787830375.683481:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f65c475-02cd-4018-98b1-85148034a57b:3638:1874675316844416:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.683487:0:25270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787830375.683495:0:25270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316845184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.683543:0:25270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316845184:12345-0@lo:400:kworker.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.683549:0:25270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787830375.683567:0:25270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:2.0:1787830375.683576:0:25270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:2395:x1874675295762048:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787830375.683597:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316844544 00000100:00100000:0.0:1787830375.683603:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316844544 00000100:00100000:0.0:1787830375.683628:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316846080 00000100:00100000:0.0:1787830375.683631:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316846080 00000100:00100000:0.0:1787830375.683647:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787830375.683655:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316844544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787830375.683677:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787830375.683719:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316844544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (6730us total) trans 0 rc 0/0 00002000:00010000:2.0:1787830375.683744:0:25270:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1787830375.683745:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00002000:00010000:2.0:1787830375.683750:0:25270:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787830373 00002000:00010000:2.0:1787830375.683755:0:25270:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787830372 00002000:00010000:2.0:1787830375.683758:0:25270:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787830375 -> 1787830373 00002000:00010000:2.0:1787830375.683761:0:25270:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787830375.683767:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787830375.683775:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316846080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787830375.683786:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787830375.683817:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316846080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.683826:0:25270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:2395:x1874675295762048:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 250us (3478us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787830375.683836:0:25270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787830375.683845:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787830375.683888:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316845184:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.684078:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316845696:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.684117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830375.684150:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874675316845568:0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.684168:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316846080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787830375.684181:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316844544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787830375.684233:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845696 00000100:00100000:2.0:1787830375.684238:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845696 00000100:00100000:2.0:1787830375.684277:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787830375.684285:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25b7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316845696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.684337:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25b7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874675316845696:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.684343:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1787830375.684371:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f258b7db480 x1874675316845696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787830391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787830375.684381:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874675316845696:0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.686466:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316845056 00000100:00100000:1.0:1787830375.686480:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316845056 00000100:00100000:1.0:1787830375.686613:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316844672 00000100:00100000:1.0:1787830375.686618:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316844672 00000100:00100000:3.0:1787830375.686632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.686645:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787830375.686656:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787830375.687326:0:25270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762176 00000100:00100000:2.0:1787830375.687333:0:25270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762176 00000100:00100000:2.0:1787830375.687375:0:25270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1787830375.687383:0:25270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:2395:x1874675295762176:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787830375.687421:0:25270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.687442:0:25270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.687472:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787830375.687477:0:25270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787830375.687483:0:25270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.687521:0:25270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.687626:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874675316845056:12345-0@lo:400:kworker.0 Request processed in 970us (7943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.687634:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787830375.687661:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787830375.687668:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316844672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.687714:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bd29b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316844672:12345-0@lo:400:kworker.0 Request processed in 46us (7852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.687721:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787830375.687769:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787830375.687774:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787830375.687777:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787830375.688004:0:25270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.688023:0:25270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:25270:1874675316846208:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830375.688105:0:25270:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787830375.693763:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25928cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874675316845056:0@lo:400:kworker.0 00000100:00100000:3.0:1787830375.693818:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24833aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316844672:0@lo:400:kworker.0 00000100:00100000:1.0:1787830375.694452:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.694786:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762304 00000100:00100000:3.0:1787830375.694794:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762304 00010000:00010000:3.0:1787830375.694835:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 9 pid: 24169 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830375.694883:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1787830375.694894:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:2395:x1874675295762304:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787830375.694932:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787830375.694958:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 9 pid: 24169 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.694973:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 9 pid: 24169 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.695003:0:22646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830375.695008:0:22646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787830375.695015:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.695025:0:22646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.695047:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787830375.695106:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+9:2395:x1874675295762304:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 213us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.695136:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00010000:00010000:2.0:1787830375.699401:0:25270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ca1254d/0x8eaa8d1f2dfc2bcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c36 expref: 8 pid: 24169 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.699431:0:25270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:25270:1874675316846208:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787830375.699461:0:25270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699474:0:25270:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699503:0:25270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699545:0:25270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699554:0:25270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699563:0:25270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699571:0:25270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f25906c8c00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:2.0:1787830375.699577:0:25270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699587:0:25270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699607:0:25270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.699615:0:25270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029195999/0x8eaa8d1f2dfc2bd6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.699760:0:25270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:2395:x1874675295762176:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 12342us (13098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.699771:0:25270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:1.0:1787830375.704122:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.704206:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762560 00000100:00100000:2.0:1787830375.704216:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762560 00000100:00100000:2.0:1787830375.704284:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:2.0:1787830375.704294:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+15:18879:x1874675295762560:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787830375.704382:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.704400:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 15 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.704409:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.704445:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 15 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.704458:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 15 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.704472:0:22660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316846336:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830375.704681:0:22660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830375.710627:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787830375.710755:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762688 00000100:00100000:1.0:1787830375.710766:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762688 00010000:00010000:1.0:1787830375.710807:0:23413:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787830375.710844:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1787830375.710855:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+16:2394:x1874675295762688:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787830375.710882:0:23413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787830375.710898:0:23413:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.710916:0:23413:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.710942:0:23413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:1.0:1787830375.710949:0:23413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 16 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.710980:0:23413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.710989:0:23413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.710997:0:23413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.711019:0:23413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787830375.711077:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+16:2394:x1874675295762688:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 224us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.711085:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00010000:00010000:2.0:1787830375.711300:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124200/0x8eaa8d1f2dfc2ab0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827bd4 expref: 15 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.711331:0:22660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316846336:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787830375.711353:0:22660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711362:0:22660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711368:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711580:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711592:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 15 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711601:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711629:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 15 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.711644:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 15 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.711659:0:22660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316846464:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787830375.711710:0:22660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2483c38180 going to sleep for 11 seconds 00000100:00100000:0.0:1787830375.720627:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.720820:0:22660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316846464:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787830375.720853:0:22660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787830375.723909:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762816 00000100:00100000:3.0:1787830375.723928:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762816 00010000:00010000:0.0:1787830375.724166:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787830375.724225:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1787830375.724236:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bb5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+16:2395:x1874675295762816:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787830375.724254:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787830375.724261:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.724277:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.724301:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125400/0x8eaa8d1f2dfc2bac lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c21 expref: 16 pid: 22662 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.724321:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:0.0:1787830375.724327:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.724338:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.724347:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.724404:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787830375.724481:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bb5ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+15:2395:x1874675295762816:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 246us (3863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830375.724490:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00010000:00010000:2.0:1787830375.724590:0:22660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.724600:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787830375.724771:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1787830375.724924:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1787830375.724962:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1787830375.725046:0:22660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22660:1874675316846592:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787830375.725104:0:22660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830375.725131:0:22660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25862d4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830375.725654:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316846592 00000100:00100000:0.0:1787830375.725663:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316846592 00000100:00100000:0.0:1787830375.725713:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787830375.725721:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22660:x1874675316846592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787830375.725829:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22660:x1874675316846592:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830375.725836:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787830375.727092:0:22660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22660:1874675316846592:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787830375.727309:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1787830375.727384:0:22660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22660:1874675316846720:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787830375.727463:0:22660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787830375.727489:0:22660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f25a01c0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787830375.727635:0:23622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316846720 00000100:00100000:1.0:1787830375.727643:0:23622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316846720 00000100:00100000:1.0:1787830375.727691:0:23622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787830375.727699:0:23622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22660:x1874675316846720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787830375.728000:0:23622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22660:x1874675316846720:12345-0@lo:1000:mdt00_000.0 Request processed in 194us (429us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1787830375.728009:0:23622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787830375.728176:0:22660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22660:1874675316846720:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787830375.728228:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728239:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728247:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728263:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121d600 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.728267:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728275:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728292:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:2.0:1787830375.728295:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787830375.728301:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728308:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2be4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728344:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728350:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728354:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728358:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482124e00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.728361:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728366:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728386:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.728388:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787830375.728395:0:22660:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728407:0:22660:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728415:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.728469:0:22660:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f25906c8000/0x8eaa8d1f2dfc2b43 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c05 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.728483:0:22660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7c4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316846848:192.168.204.30@tcp:105: 00000100:00100000:2.0:1787830375.728644:0:22660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2590769d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787830375.749371:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.749488:0:22660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7c4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22660:1874675316846848:192.168.204.30@tcp:105: 00010000:00010000:2.0:1787830375.749527:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749540:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482124e00/0x8eaa8d1f2dfc2b3c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749581:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749596:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749624:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749636:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749642:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749647:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749652:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121c000 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.749656:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749663:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749674:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.749677:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.749681:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749685:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2beb lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749696:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749702:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749715:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749719:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121de00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.749722:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749757:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749766:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.749769:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830375.749771:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.749778:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2bdd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.749967:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+18:18879:x1874675295762560:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 45673us (45854us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1787830375.749977:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000020:00080000:2.0:1787830375.749983:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787830375.750135:0:22696:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787830375.750139:0:22696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787830375.750156:0:22696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787830375.750162:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787830375.750387:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295762944 00000100:00100000:3.0:1787830375.750396:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295762944 00000100:00100000:3.0:1787830375.750446:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:3.0:1787830375.750457:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bfbc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+18:18878:x1874675295762944:12345-192.168.204.30@tcp:49:bash.0 00000100:00100000:3.0:1787830375.750557:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bfbc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+18:18878:x1874675295762944:12345-192.168.204.30@tcp:49:bash.0 Request processed in 102us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830375.750564:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:2.0:1787830375.758466:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830375.758546:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295763328 00000100:00100000:3.0:1787830375.758558:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295763328 00000100:00100000:3.0:1787830375.758618:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787830375.758631:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+18:18879:x1874675295763328:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787830375.759003:0:22664:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787830375.759035:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:3.0:1787830375.759068:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.759085:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.759098:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.759107:0:22664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.759134:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.759140:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787830375.759157:0:22664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787830375.759269:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+20:18879:x1874675295763328:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 639us (813us total) trans 12884901926 rc 0/0 00000100:00100000:3.0:1787830375.759277:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000020:00080000:3.0:1787830375.759282:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787830375.759455:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787830375.759462:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.759470:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2482125e00 already unused, calling callback (ffffffffc0c5b420) 00010000:00010000:0.0:1787830375.759475:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.759483:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.759497:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f248245ff00) 00010000:00010000:0.0:1787830375.759506:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787830375.759512:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.759518:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2482125e00/0x8eaa8d1f2dfc2bf2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787830375.759532:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830375.759534:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787830375.759535:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830375.768373:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830375.768612:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295763072 00000100:00100000:0.0:1787830375.768624:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295763072 00000100:00100000:1.0:1787830375.772880:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:1.0:1787830375.772909:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+7:18878:x1874675295763072:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787830375.772930:0:24167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787830375.772952:0:24167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8dd506d/0x8eaa8d1f2dfc2bf9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c3d expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787830375.773001:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a902065, atime: 0x6a902064, ctime: 0x6a902065, blocks: 0x0 00010000:00010000:1.0:1787830375.773026:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1787830375.773031:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787830375.773042:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8dd506d/0x8eaa8d1f2dfc2bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c3d expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.773059:0:24167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8dd506d/0x8eaa8d1f2dfc2bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c3d expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787830375.773071:0:24167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f25b7d33e00, rc 0) 00000100:00100000:1.0:1787830375.773146:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:18878:x1874675295763072:12345-192.168.204.30@tcp:101:bash.0 Request processed in 253us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830375.773154:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:1.0:1787830375.778970:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.779076:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295763456 00000100:00100000:2.0:1787830375.779086:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295763456 00000100:00100000:2.0:1787830375.779150:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:2.0:1787830375.779160:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+20:18878:x1874675295763456:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787830375.779185:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830375.779218:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c00 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c44 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.779271:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2c07 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.779286:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2c07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.779297:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2c07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.779407:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c00 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c44 expref: 22 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.779425:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121c000/0x8eaa8d1f2dfc2c07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c44 expref: 21 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.779433:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.779437:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787830375.779440:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f258121c000, rc 0) 00000100:00100000:2.0:1787830375.779507:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18878:x1874675295763456:12345-192.168.204.30@tcp:101:bash.0 Request processed in 349us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.779515:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:3.0:1787830375.782998:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830375.783115:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295763712 00000100:00100000:0.0:1787830375.783125:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295763712 00000100:00100000:0.0:1787830375.783184:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1787830375.783226:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+21:18878:x1874675295763712:12345-192.168.204.30@tcp:35:bash.0 00000001:00080000:0.0:1787830375.783446:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1787830375.783528:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1787830375.783642:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+24:18878:x1874675295763712:12345-192.168.204.30@tcp:35:bash.0 Request processed in 448us (652us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1787830375.783650:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000020:00080000:0.0:1787830375.783655:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787830375.967201:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.968950:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295763968 00000100:00100000:2.0:1787830375.968965:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295763968 00000100:00100000:2.0:1787830375.969049:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:2.0:1787830375.969059:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+24:18889:x1874675295763968:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787830375.969082:0:24451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787830375.969104:0:24451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc41f6f5f4827c4b expref: -99 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787830375.969234:0:24451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787830375.969327:0:24451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c4b expref: 26 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.969341:0:24451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f258699c000) 00010000:00010000:2.0:1787830375.969344:0:24451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787830375.969349:0:24451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xfc41f6f5f4827c4b expref: 26 pid: 24451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.969363:0:24451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f258121de00, rc 0) 00000100:00100000:2.0:1787830375.969429:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18889:x1874675295763968:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 371us (2255us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1787830375.969436:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:1.0:1787830375.976083:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830375.976282:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764096 00000100:00100000:2.0:1787830375.976293:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764096 00000100:00100000:2.0:1787830375.976358:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:2.0:1787830375.976369:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18889:x1874675295764096:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1787830375.976462:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976480:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976493:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976509:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976531:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976538:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976634:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976644:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976651:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787830375.976708:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976721:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976755:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976761:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976768:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121de00 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.976772:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976779:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976800:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f2482462000) 00010000:00010000:2.0:1787830375.976803:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.976808:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976815:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121de00/0x8eaa8d1f2dfc2c1c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976842:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976848:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976854:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976860:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121d600 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.976863:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976868:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976877:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f258699ce00) 00010000:00010000:2.0:1787830375.976879:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.976882:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976887:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d600/0x8eaa8d1f2dfc2c23 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976913:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976920:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976926:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976931:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f258121d800 already unused, calling callback (ffffffffc186e4f0) 00010000:00010000:2.0:1787830375.976934:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976940:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976947:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f2482462100) 00010000:00010000:2.0:1787830375.976950:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787830375.976953:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787830375.976959:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f258121d800/0x8eaa8d1f2dfc2c2a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787830375.977230:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18889:x1874675295764096:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 860us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830375.977240:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:3.0:1787830375.984258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830375.987334:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764352 00000100:00100000:0.0:1787830375.987351:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764352 00000100:00100000:0.0:1787830375.987432:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787830375.987454:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+25:18889:x1874675295764352:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787830375.987705:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+26:18889:x1874675295764352:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 253us (3457us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1787830375.987714:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00010000:00010000:2.0:1787830376.061559:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830376.189262:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316846976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787830376.189350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830376.190297:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316846976 00000100:00100000:0.0:1787830376.190307:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316846976 00000100:00100000:0.0:1787830376.190367:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787830376.190377:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316846976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787830376.190406:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787830376.193124:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874675316846976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2725us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830376.193141:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787830376.193620:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f24837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874675316846976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787830376.701111:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316847104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787830376.701199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830376.701392:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316847104 00000100:00100000:0.0:1787830376.701401:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316847104 00000100:00100000:0.0:1787830376.701462:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787830376.701471:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316847104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787830376.702207:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787830376.702290:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874675316847104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 819us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830376.702299:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787830376.702549:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874675316847104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787830376.702898:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f258b7d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316847232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787830376.702943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787830376.703107:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316847232 00000100:00100000:1.0:1787830376.703113:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316847232 00000100:00100000:1.0:1787830376.703157:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787830376.703166:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24837ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316847232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787830376.703203:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1787830376.703261:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24837ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874675316847232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830376.703278:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787830376.703525:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f258b7d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874675316847232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787830377.087019:0:24673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787830377.501612:0:25744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:1.0:1787830377.853423:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787830378.113604:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787830378.147980:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830378.148031:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830378.148056:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764480 00000100:00100000:2.0:1787830378.148067:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764480 00000100:00100000:3.0:1787830378.148070:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830378.148102:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830378.148122:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 171 00000100:00100000:3.0:1787830378.148125:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787830378.148133:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25bdb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2392:x1874675295764480:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.148155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830378.148178:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830378.148267:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764736 00000100:00100000:0.0:1787830378.148272:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764736 00000100:00100000:1.0:1787830378.148301:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764992 00000100:00100000:1.0:1787830378.148305:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764992 00000100:00100000:0.0:1787830378.148312:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295765248 00000100:00100000:0.0:1787830378.148315:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295765248 00000100:00100000:0.0:1787830378.148327:0:24451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764608 00000100:00100000:0.0:1787830378.148329:0:24451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764608 00000100:00100000:1.0:1787830378.148343:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295765504 00000100:00100000:1.0:1787830378.148346:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295765504 00000100:00100000:1.0:1787830378.148361:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295764864 00000100:00100000:1.0:1787830378.148364:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295764864 00000100:00100000:1.0:1787830378.148378:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1787830378.148384:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295764992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787830378.148432:0:24451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:0.0:1787830378.148705:0:24451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295764736:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787830378.148837:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25bdb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b8f2ab-7870-44f1-93df-2a3b3577fec3+13:2392:x1874675295764480:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830378.148848:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 171 00000100:00100000:2.0:1787830378.148909:0:25270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:2.0:1787830378.148918:0:25270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295765504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.152320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830378.152978:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830378.153012:0:24167:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830378.153023:0:24167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787830378.153083:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295765120 00000100:00100000:3.0:1787830378.153092:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295765120 00000100:00100000:3.0:1787830378.153143:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:3.0:1787830378.153166:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f258b7d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295765248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.153252:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295765248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 89us (5147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830378.153261:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:3.0:1787830378.153280:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1787830378.153287:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+26:2392:x1874675295764608:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.153320:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+26:2392:x1874675295764608:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830378.153326:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1787830378.153453:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1787830378.153460:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2392:x1874675295765120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.153488:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+6:2392:x1874675295765120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830378.153495:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1787830378.153522:0:24170:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830378.153528:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295765376 00000100:00100000:3.0:1787830378.153531:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295765376 00000100:00100000:3.0:1787830378.153555:0:24170:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830378.153562:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:3.0:1787830378.153568:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f24833aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:2392:x1874675295764864:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.153610:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:2392:x1874675295764864:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (5430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830378.153617:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:3.0:1787830378.153629:0:24170:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787830378.153635:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1787830378.153641:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295765376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787830378.153663:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f25928cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295765376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787830378.153670:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00080000:3.0:1787830378.153991:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787830378.153996:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787830378.153999:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787830378.154001:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787830378.154277:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295764992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 5889us (6201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787830378.154287:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787830378.155754:0:24451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f258b7d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a02fe4e-043f-4c80-a280-961ccf82a0ae+5:2392:x1874675295764736:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 7045us (7713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830378.155806:0:24451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1787830378.156100:0:25270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f24833aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dccc238e-e1d7-4d48-8c0b-2d5716f85f4d+5:2392:x1874675295765504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 7181us (7970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787830378.156123:0:25270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:3.0:1787830378.663888:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787830378.663951:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787830378.664216:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295765632 00000100:00100000:0.0:1787830378.664226:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295765632 00002000:00100000:0.0:1787830378.664274:0:24173:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9f2482411a40 x1874675295765632/t0(0) o4->9a02fe4e-043f-4c80-a280-961ccf82a0ae@192.168.204.30@tcp:204/0 lens 504/0 e 0 to 0 dl 1787830389 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787830378.664417:0:24173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482411a40 with x1874675295765632 ext(0->8) 00002000:00010000:0.0:1787830378.664424:0:24173:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2482411a40 00000100:00100000:0.0:1787830378.664465:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787830378.664476:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482411a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+8:2393:x1874675295765632:12345-192.168.204.30@tcp:4:bash.0 00000100:00100000:0.0:1787830378.665906:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482411a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a02fe4e-043f-4c80-a280-961ccf82a0ae+10:2393:x1874675295765632:12345-192.168.204.30@tcp:4:bash.0 Request processed in 1425us (2021us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787830378.665918:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:0.0:1787830378.665928:0:24173:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9f2482411a40 x1874675295765632/t12884901895(0) o4->9a02fe4e-043f-4c80-a280-961ccf82a0ae@192.168.204.30@tcp:204/0 lens 504/448 e 0 to 0 dl 1787830389 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787830378.665937:0:24173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2482411a40 with x1874675295765632 ext(0->8) 00002000:00010000:0.0:1787830378.665943:0:24173:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f2482411a40 00000100:00100000:2.0:1787830378.666042:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675295765760 00000100:00100000:2.0:1787830378.666050:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675295765760 00000100:00100000:2.0:1787830378.666231:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1787830378.666241:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2482413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+10:2393:x1874675295765760:12345-192.168.204.30@tcp:16:kworker.0 00000001:00080000:2.0:1787830378.668115:0:24164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1787830378.668130:0:24164:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:0.0:1787830378.679040:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2482413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a02fe4e-043f-4c80-a280-961ccf82a0ae+6:2393:x1874675295765760:12345-192.168.204.30@tcp:16:kworker.0 Request processed in 12790us (15077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830378.679053:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00010000:00010000:2.0:1787830379.133102:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787830379.264051:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316847360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787830379.264149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787830379.264265:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874675316847360 00000100:00100000:0.0:1787830379.264274:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874675316847360 00000100:00100000:0.0:1787830379.264358:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830379.264369:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2483c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316847360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787830379.264395:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:0.0:1787830379.264463:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2483c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874675316847360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787830379.264472:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787830379.264519:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1787830379.264537:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f24833ab840, transno 12884901892 00000004:00080000:0.0:1787830379.264550:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1787830379.264593:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f25bfbc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874675316847360:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787830379.264896:0:22657:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 14953 lines, 14953 kept, 0 dropped, 0 bad.